2023-07-21 10:11:59,743 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-21 10:12:00,054 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763 2023-07-21 10:12:00,055 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-21 10:12:00,107 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-21 10:12:00,433 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-21 10:12:00,434 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998, deleteOnExit=true 2023-07-21 10:12:00,434 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-21 10:12:00,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/test.cache.data in system properties and HBase conf 2023-07-21 10:12:00,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 10:12:00,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop.log.dir in system properties and HBase conf 2023-07-21 10:12:00,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 10:12:00,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 10:12:00,437 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 10:12:00,985 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-21 10:12:00,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 10:12:00,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 10:12:00,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 10:12:00,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 10:12:01,002 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 10:12:01,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 10:12:01,007 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 10:12:01,010 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 10:12:01,011 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 10:12:01,012 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/nfs.dump.dir in system properties and HBase conf 2023-07-21 10:12:01,013 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir in system properties and HBase conf 2023-07-21 10:12:01,013 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 10:12:01,013 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 10:12:01,014 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-21 10:12:01,836 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 10:12:01,843 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 10:12:02,299 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-21 10:12:02,580 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-21 10:12:02,607 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:02,668 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:02,727 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir/Jetty_localhost_localdomain_44085_hdfs____lapcav/webapp 2023-07-21 10:12:02,987 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:44085 2023-07-21 10:12:03,001 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 10:12:03,001 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 10:12:03,987 WARN [Listener at localhost.localdomain/46589] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 10:12:04,272 WARN [Listener at localhost.localdomain/46589] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 10:12:04,322 WARN [Listener at localhost.localdomain/46589] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:04,335 INFO [Listener at localhost.localdomain/46589] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:04,350 INFO [Listener at localhost.localdomain/46589] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir/Jetty_localhost_43895_datanode____gq3rvg/webapp 2023-07-21 10:12:04,491 INFO [Listener at localhost.localdomain/46589] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43895 2023-07-21 10:12:05,055 WARN [Listener at localhost.localdomain/38135] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 10:12:05,088 WARN [Listener at localhost.localdomain/38135] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 10:12:05,094 WARN [Listener at localhost.localdomain/38135] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:05,096 INFO [Listener at localhost.localdomain/38135] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:05,115 INFO [Listener at localhost.localdomain/38135] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir/Jetty_localhost_38279_datanode____cxtzli/webapp 2023-07-21 10:12:05,256 INFO [Listener at localhost.localdomain/38135] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38279 2023-07-21 10:12:05,280 WARN [Listener at localhost.localdomain/46819] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 10:12:05,331 WARN [Listener at localhost.localdomain/46819] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 10:12:05,344 WARN [Listener at localhost.localdomain/46819] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:05,347 INFO [Listener at localhost.localdomain/46819] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:05,359 INFO [Listener at localhost.localdomain/46819] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir/Jetty_localhost_42175_datanode____9fdomw/webapp 2023-07-21 10:12:05,551 INFO [Listener at localhost.localdomain/46819] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42175 2023-07-21 10:12:05,620 WARN [Listener at localhost.localdomain/36149] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 10:12:06,017 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5ed86fda276aeacf: Processing first storage report for DS-39c4e183-977e-4853-8485-26309790d6ac from datanode f8329972-a431-4fbb-a07c-8bb37c7d6417 2023-07-21 10:12:06,029 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5ed86fda276aeacf: from storage DS-39c4e183-977e-4853-8485-26309790d6ac node DatanodeRegistration(127.0.0.1:33027, datanodeUuid=f8329972-a431-4fbb-a07c-8bb37c7d6417, infoPort=43547, infoSecurePort=0, ipcPort=38135, storageInfo=lv=-57;cid=testClusterID;nsid=783774622;c=1689934321960), blocks: 0, hasStaleStorage: true, processing time: 13 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,033 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d704ca0db086c6b: Processing first storage report for DS-6e5467f9-b022-4924-982e-eeba3cd3c35f from datanode c12952fd-8e7b-4b19-aa65-fbaadedd8c63 2023-07-21 10:12:06,034 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d704ca0db086c6b: from storage DS-6e5467f9-b022-4924-982e-eeba3cd3c35f node DatanodeRegistration(127.0.0.1:41203, datanodeUuid=c12952fd-8e7b-4b19-aa65-fbaadedd8c63, infoPort=45105, infoSecurePort=0, ipcPort=46819, storageInfo=lv=-57;cid=testClusterID;nsid=783774622;c=1689934321960), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,034 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5ed86fda276aeacf: Processing first storage report for DS-bc59347b-b603-4916-a59b-d9c7f93840e8 from datanode f8329972-a431-4fbb-a07c-8bb37c7d6417 2023-07-21 10:12:06,034 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5ed86fda276aeacf: from storage DS-bc59347b-b603-4916-a59b-d9c7f93840e8 node DatanodeRegistration(127.0.0.1:33027, datanodeUuid=f8329972-a431-4fbb-a07c-8bb37c7d6417, infoPort=43547, infoSecurePort=0, ipcPort=38135, storageInfo=lv=-57;cid=testClusterID;nsid=783774622;c=1689934321960), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,034 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d704ca0db086c6b: Processing first storage report for DS-9af432cd-a02c-4bed-abc4-c70f390992b8 from datanode c12952fd-8e7b-4b19-aa65-fbaadedd8c63 2023-07-21 10:12:06,034 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d704ca0db086c6b: from storage DS-9af432cd-a02c-4bed-abc4-c70f390992b8 node DatanodeRegistration(127.0.0.1:41203, datanodeUuid=c12952fd-8e7b-4b19-aa65-fbaadedd8c63, infoPort=45105, infoSecurePort=0, ipcPort=46819, storageInfo=lv=-57;cid=testClusterID;nsid=783774622;c=1689934321960), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,056 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb933b85fe56acce7: Processing first storage report for DS-c0b44846-588c-46c8-b274-4abe87fb1d58 from datanode a7008744-80b7-4b09-a2ff-066906b34500 2023-07-21 10:12:06,057 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb933b85fe56acce7: from storage DS-c0b44846-588c-46c8-b274-4abe87fb1d58 node DatanodeRegistration(127.0.0.1:45209, datanodeUuid=a7008744-80b7-4b09-a2ff-066906b34500, infoPort=46433, infoSecurePort=0, ipcPort=36149, storageInfo=lv=-57;cid=testClusterID;nsid=783774622;c=1689934321960), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,057 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb933b85fe56acce7: Processing first storage report for DS-1d56307f-15b2-4938-93a0-e30bb3a49a33 from datanode a7008744-80b7-4b09-a2ff-066906b34500 2023-07-21 10:12:06,057 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb933b85fe56acce7: from storage DS-1d56307f-15b2-4938-93a0-e30bb3a49a33 node DatanodeRegistration(127.0.0.1:45209, datanodeUuid=a7008744-80b7-4b09-a2ff-066906b34500, infoPort=46433, infoSecurePort=0, ipcPort=36149, storageInfo=lv=-57;cid=testClusterID;nsid=783774622;c=1689934321960), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 10:12:06,270 DEBUG [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763 2023-07-21 10:12:06,374 INFO [Listener at localhost.localdomain/36149] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/zookeeper_0, clientPort=60277, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-21 10:12:06,395 INFO [Listener at localhost.localdomain/36149] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60277 2023-07-21 10:12:06,408 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:06,411 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:06,839 INFO [Listener at localhost.localdomain/36149] util.FSUtils(471): Created version file at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a with version=8 2023-07-21 10:12:06,840 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/hbase-staging 2023-07-21 10:12:07,296 INFO [Listener at localhost.localdomain/36149] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-21 10:12:08,000 INFO [Listener at localhost.localdomain/36149] client.ConnectionUtils(127): master/jenkins-hbase17:0 server-side Connection retries=45 2023-07-21 10:12:08,054 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,055 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,055 INFO [Listener at localhost.localdomain/36149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 10:12:08,056 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,056 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 10:12:08,294 INFO [Listener at localhost.localdomain/36149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 10:12:08,378 DEBUG [Listener at localhost.localdomain/36149] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-21 10:12:08,485 INFO [Listener at localhost.localdomain/36149] ipc.NettyRpcServer(120): Bind to /136.243.18.41:38671 2023-07-21 10:12:08,498 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,500 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,526 INFO [Listener at localhost.localdomain/36149] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38671 connecting to ZooKeeper ensemble=127.0.0.1:60277 2023-07-21 10:12:08,583 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:386710x0, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 10:12:08,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38671-0x101875ce56c0000 connected 2023-07-21 10:12:08,630 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:12:08,634 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:12:08,651 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 10:12:08,663 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38671 2023-07-21 10:12:08,663 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38671 2023-07-21 10:12:08,664 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38671 2023-07-21 10:12:08,668 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38671 2023-07-21 10:12:08,670 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38671 2023-07-21 10:12:08,677 INFO [Listener at localhost.localdomain/36149] master.HMaster(444): hbase.rootdir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a, hbase.cluster.distributed=false 2023-07-21 10:12:08,737 INFO [Listener at localhost.localdomain/36149] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-21 10:12:08,737 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,737 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,738 INFO [Listener at localhost.localdomain/36149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 10:12:08,738 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,738 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 10:12:08,744 INFO [Listener at localhost.localdomain/36149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 10:12:08,749 INFO [Listener at localhost.localdomain/36149] ipc.NettyRpcServer(120): Bind to /136.243.18.41:35819 2023-07-21 10:12:08,753 INFO [Listener at localhost.localdomain/36149] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 10:12:08,768 DEBUG [Listener at localhost.localdomain/36149] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 10:12:08,770 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,772 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,774 INFO [Listener at localhost.localdomain/36149] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35819 connecting to ZooKeeper ensemble=127.0.0.1:60277 2023-07-21 10:12:08,777 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:358190x0, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 10:12:08,778 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): regionserver:358190x0, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:12:08,781 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): regionserver:358190x0, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:12:08,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35819-0x101875ce56c0001 connected 2023-07-21 10:12:08,783 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 10:12:08,784 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35819 2023-07-21 10:12:08,788 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35819 2023-07-21 10:12:08,790 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35819 2023-07-21 10:12:08,792 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35819 2023-07-21 10:12:08,793 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35819 2023-07-21 10:12:08,804 INFO [Listener at localhost.localdomain/36149] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-21 10:12:08,804 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,804 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,805 INFO [Listener at localhost.localdomain/36149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 10:12:08,805 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,805 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 10:12:08,805 INFO [Listener at localhost.localdomain/36149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 10:12:08,807 INFO [Listener at localhost.localdomain/36149] ipc.NettyRpcServer(120): Bind to /136.243.18.41:42413 2023-07-21 10:12:08,808 INFO [Listener at localhost.localdomain/36149] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 10:12:08,813 DEBUG [Listener at localhost.localdomain/36149] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 10:12:08,814 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,818 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,821 INFO [Listener at localhost.localdomain/36149] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42413 connecting to ZooKeeper ensemble=127.0.0.1:60277 2023-07-21 10:12:08,827 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:424130x0, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 10:12:08,828 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): regionserver:424130x0, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:12:08,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42413-0x101875ce56c0002 connected 2023-07-21 10:12:08,829 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:12:08,830 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 10:12:08,831 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42413 2023-07-21 10:12:08,831 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42413 2023-07-21 10:12:08,832 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42413 2023-07-21 10:12:08,836 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42413 2023-07-21 10:12:08,838 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42413 2023-07-21 10:12:08,850 INFO [Listener at localhost.localdomain/36149] client.ConnectionUtils(127): regionserver/jenkins-hbase17:0 server-side Connection retries=45 2023-07-21 10:12:08,850 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,850 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,850 INFO [Listener at localhost.localdomain/36149] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 10:12:08,850 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 10:12:08,850 INFO [Listener at localhost.localdomain/36149] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 10:12:08,851 INFO [Listener at localhost.localdomain/36149] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 10:12:08,852 INFO [Listener at localhost.localdomain/36149] ipc.NettyRpcServer(120): Bind to /136.243.18.41:38115 2023-07-21 10:12:08,853 INFO [Listener at localhost.localdomain/36149] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 10:12:08,860 DEBUG [Listener at localhost.localdomain/36149] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-21 10:12:08,862 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,864 INFO [Listener at localhost.localdomain/36149] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:08,865 INFO [Listener at localhost.localdomain/36149] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38115 connecting to ZooKeeper ensemble=127.0.0.1:60277 2023-07-21 10:12:08,872 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:381150x0, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 10:12:08,873 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): regionserver:381150x0, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:12:08,874 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): regionserver:381150x0, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:12:08,875 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ZKUtil(164): regionserver:381150x0, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 10:12:08,877 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38115-0x101875ce56c0003 connected 2023-07-21 10:12:08,884 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38115 2023-07-21 10:12:08,884 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38115 2023-07-21 10:12:08,885 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38115 2023-07-21 10:12:08,885 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38115 2023-07-21 10:12:08,885 DEBUG [Listener at localhost.localdomain/36149] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38115 2023-07-21 10:12:08,890 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:12:08,900 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 10:12:08,902 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:12:08,924 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 10:12:08,924 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 10:12:08,925 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 10:12:08,925 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:08,927 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 10:12:08,928 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 10:12:08,928 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase17.apache.org,38671,1689934327089 from backup master directory 2023-07-21 10:12:08,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 10:12:08,933 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:12:08,933 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 10:12:08,937 WARN [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 10:12:08,937 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:12:08,942 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-21 10:12:08,944 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-21 10:12:09,065 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/hbase.id with ID: b1ab69e8-a90a-428f-bf75-64cd12dc6ea6 2023-07-21 10:12:09,120 INFO [master/jenkins-hbase17:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 10:12:09,137 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:09,204 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x36f8b77d to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:09,268 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d2c2fee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:09,297 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:09,299 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-21 10:12:09,319 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-21 10:12:09,320 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-21 10:12:09,322 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 10:12:09,327 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 10:12:09,328 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:09,373 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/data/master/store-tmp 2023-07-21 10:12:09,449 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:09,449 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 10:12:09,449 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:12:09,450 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:12:09,450 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 10:12:09,450 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:12:09,450 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:12:09,450 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 10:12:09,452 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/WALs/jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:12:09,490 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C38671%2C1689934327089, suffix=, logDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/WALs/jenkins-hbase17.apache.org,38671,1689934327089, archiveDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/oldWALs, maxLogs=10 2023-07-21 10:12:09,576 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK] 2023-07-21 10:12:09,576 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK] 2023-07-21 10:12:09,576 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK] 2023-07-21 10:12:09,589 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-21 10:12:09,736 INFO [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/WALs/jenkins-hbase17.apache.org,38671,1689934327089/jenkins-hbase17.apache.org%2C38671%2C1689934327089.1689934329504 2023-07-21 10:12:09,752 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK], DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK], DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK]] 2023-07-21 10:12:09,753 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:12:09,754 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:09,759 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:09,761 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:09,842 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:09,861 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-21 10:12:09,901 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-21 10:12:09,917 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:09,928 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:09,932 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:09,955 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 10:12:09,963 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:09,964 INFO [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63494368, jitterRate=-0.05386018753051758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:09,965 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 10:12:09,968 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-21 10:12:09,998 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-21 10:12:09,998 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-21 10:12:10,002 INFO [master/jenkins-hbase17:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-21 10:12:10,005 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-21 10:12:10,046 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 40 msec 2023-07-21 10:12:10,046 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-21 10:12:10,079 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-21 10:12:10,085 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-21 10:12:10,118 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-21 10:12:10,125 INFO [master/jenkins-hbase17:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-21 10:12:10,127 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-21 10:12:10,135 INFO [master/jenkins-hbase17:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-21 10:12:10,141 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-21 10:12:10,149 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:10,152 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-21 10:12:10,152 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-21 10:12:10,171 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-21 10:12:10,176 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 10:12:10,176 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 10:12:10,177 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 10:12:10,176 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 10:12:10,177 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:10,177 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase17.apache.org,38671,1689934327089, sessionid=0x101875ce56c0000, setting cluster-up flag (Was=false) 2023-07-21 10:12:10,197 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:10,202 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-21 10:12:10,204 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:12:10,210 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:10,214 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-21 10:12:10,216 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:12:10,218 WARN [master/jenkins-hbase17:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp 2023-07-21 10:12:10,302 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(951): ClusterId : b1ab69e8-a90a-428f-bf75-64cd12dc6ea6 2023-07-21 10:12:10,323 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(951): ClusterId : b1ab69e8-a90a-428f-bf75-64cd12dc6ea6 2023-07-21 10:12:10,341 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(951): ClusterId : b1ab69e8-a90a-428f-bf75-64cd12dc6ea6 2023-07-21 10:12:10,363 DEBUG [RS:1;jenkins-hbase17:42413] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 10:12:10,363 DEBUG [RS:2;jenkins-hbase17:38115] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 10:12:10,363 DEBUG [RS:0;jenkins-hbase17:35819] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 10:12:10,383 DEBUG [RS:2;jenkins-hbase17:38115] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 10:12:10,383 DEBUG [RS:1;jenkins-hbase17:42413] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 10:12:10,384 DEBUG [RS:0;jenkins-hbase17:35819] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 10:12:10,384 DEBUG [RS:0;jenkins-hbase17:35819] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 10:12:10,384 DEBUG [RS:2;jenkins-hbase17:38115] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 10:12:10,384 DEBUG [RS:1;jenkins-hbase17:42413] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 10:12:10,389 DEBUG [RS:2;jenkins-hbase17:38115] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 10:12:10,393 DEBUG [RS:0;jenkins-hbase17:35819] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 10:12:10,391 DEBUG [RS:2;jenkins-hbase17:38115] zookeeper.ReadOnlyZKClient(139): Connect 0x18b90173 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:10,401 DEBUG [RS:1;jenkins-hbase17:42413] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 10:12:10,405 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-21 10:12:10,412 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:10,412 INFO [master/jenkins-hbase17:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-21 10:12:10,422 DEBUG [RS:1;jenkins-hbase17:42413] zookeeper.ReadOnlyZKClient(139): Connect 0x25534e74 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:10,431 DEBUG [RS:0;jenkins-hbase17:35819] zookeeper.ReadOnlyZKClient(139): Connect 0x1be80cf7 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:10,449 DEBUG [RS:2;jenkins-hbase17:38115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@142f049a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:10,455 DEBUG [RS:2;jenkins-hbase17:38115] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@603c5d86, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-21 10:12:10,473 DEBUG [RS:0;jenkins-hbase17:35819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a249afd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:10,473 DEBUG [RS:0;jenkins-hbase17:35819] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b6c38e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-21 10:12:10,476 DEBUG [RS:1;jenkins-hbase17:42413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d0e1e43, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:10,488 DEBUG [RS:1;jenkins-hbase17:42413] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f0a3858, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-21 10:12:10,539 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase17:38115 2023-07-21 10:12:10,544 INFO [RS:2;jenkins-hbase17:38115] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 10:12:10,553 INFO [RS:2;jenkins-hbase17:38115] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 10:12:10,553 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 10:12:10,567 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase17:35819 2023-07-21 10:12:10,560 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase17:42413 2023-07-21 10:12:10,567 INFO [RS:0;jenkins-hbase17:35819] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 10:12:10,569 INFO [RS:0;jenkins-hbase17:35819] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 10:12:10,569 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 10:12:10,570 INFO [RS:2;jenkins-hbase17:38115] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:10,570 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 10:12:10,570 INFO [RS:0;jenkins-hbase17:35819] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:10,576 INFO [RS:1;jenkins-hbase17:42413] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 10:12:10,576 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 10:12:10,576 INFO [RS:1;jenkins-hbase17:42413] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 10:12:10,577 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 10:12:10,577 INFO [RS:1;jenkins-hbase17:42413] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:10,577 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 10:12:10,581 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,38671,1689934327089 with isa=jenkins-hbase17.apache.org/136.243.18.41:35819, startcode=1689934328736 2023-07-21 10:12:10,581 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,38671,1689934327089 with isa=jenkins-hbase17.apache.org/136.243.18.41:42413, startcode=1689934328803 2023-07-21 10:12:10,584 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,38671,1689934327089 with isa=jenkins-hbase17.apache.org/136.243.18.41:38115, startcode=1689934328849 2023-07-21 10:12:10,603 DEBUG [RS:0;jenkins-hbase17:35819] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 10:12:10,608 DEBUG [RS:2;jenkins-hbase17:38115] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 10:12:10,608 DEBUG [RS:1;jenkins-hbase17:42413] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 10:12:10,668 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-21 10:12:10,684 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-21 10:12:10,685 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-21 10:12:10,685 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-21 10:12:10,685 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=5, maxPoolSize=5 2023-07-21 10:12:10,685 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase17:0, corePoolSize=10, maxPoolSize=10 2023-07-21 10:12:10,685 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:10,685 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-21 10:12:10,685 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:10,733 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689934360733 2023-07-21 10:12:10,733 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:38143, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 10:12:10,734 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:45541, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 10:12:10,733 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:60369, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 10:12:10,736 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-21 10:12:10,748 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 10:12:10,749 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-21 10:12:10,749 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38671] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 10:12:10,769 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:10,776 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38671] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 10:12:10,777 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38671] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 10:12:10,813 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-21 10:12:10,833 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-21 10:12:10,834 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-21 10:12:10,834 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-21 10:12:10,835 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-21 10:12:10,835 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:10,860 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-21 10:12:10,863 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-21 10:12:10,864 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-21 10:12:10,870 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 10:12:10,871 WARN [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 10:12:10,872 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 10:12:10,872 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-21 10:12:10,872 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 10:12:10,872 WARN [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 10:12:10,872 WARN [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 10:12:10,873 INFO [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-21 10:12:10,876 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689934330875,5,FailOnTimeoutGroup] 2023-07-21 10:12:10,880 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689934330876,5,FailOnTimeoutGroup] 2023-07-21 10:12:10,880 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:10,880 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-21 10:12:10,884 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:10,884 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:10,974 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,38671,1689934327089 with isa=jenkins-hbase17.apache.org/136.243.18.41:42413, startcode=1689934328803 2023-07-21 10:12:10,987 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,38671,1689934327089 with isa=jenkins-hbase17.apache.org/136.243.18.41:35819, startcode=1689934328736 2023-07-21 10:12:11,003 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38671] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:11,006 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase17.apache.org,38671,1689934327089 with isa=jenkins-hbase17.apache.org/136.243.18.41:38115, startcode=1689934328849 2023-07-21 10:12:11,012 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38671] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:11,018 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:12:11,018 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:46589 2023-07-21 10:12:11,018 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 10:12:11,025 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38671] master.ServerManager(394): Registering regionserver=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:11,028 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:12:11,028 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:46589 2023-07-21 10:12:11,029 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 10:12:11,037 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:12:11,037 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost.localdomain:46589 2023-07-21 10:12:11,037 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 10:12:11,052 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:11,052 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:12:11,064 DEBUG [RS:0;jenkins-hbase17:35819] zookeeper.ZKUtil(162): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:11,064 DEBUG [RS:1;jenkins-hbase17:42413] zookeeper.ZKUtil(162): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:11,066 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:11,065 WARN [RS:0;jenkins-hbase17:35819] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 10:12:11,066 WARN [RS:1;jenkins-hbase17:42413] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 10:12:11,067 INFO [RS:1;jenkins-hbase17:42413] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:11,066 INFO [RS:0;jenkins-hbase17:35819] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:11,072 DEBUG [RS:2;jenkins-hbase17:38115] zookeeper.ZKUtil(162): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:11,072 WARN [RS:2;jenkins-hbase17:38115] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 10:12:11,073 INFO [RS:2;jenkins-hbase17:38115] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:11,073 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:11,072 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:11,067 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:12:11,072 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1948): logDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:11,103 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,42413,1689934328803] 2023-07-21 10:12:11,120 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,35819,1689934328736] 2023-07-21 10:12:11,121 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase17.apache.org,38115,1689934328849] 2023-07-21 10:12:11,155 DEBUG [RS:0;jenkins-hbase17:35819] zookeeper.ZKUtil(162): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:11,155 DEBUG [RS:1;jenkins-hbase17:42413] zookeeper.ZKUtil(162): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:11,156 DEBUG [RS:2;jenkins-hbase17:38115] zookeeper.ZKUtil(162): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:11,156 DEBUG [RS:1;jenkins-hbase17:42413] zookeeper.ZKUtil(162): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:11,157 DEBUG [RS:0;jenkins-hbase17:35819] zookeeper.ZKUtil(162): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:11,157 DEBUG [RS:2;jenkins-hbase17:38115] zookeeper.ZKUtil(162): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:11,157 DEBUG [RS:1;jenkins-hbase17:42413] zookeeper.ZKUtil(162): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:11,189 DEBUG [RS:0;jenkins-hbase17:35819] zookeeper.ZKUtil(162): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:11,192 DEBUG [RS:2;jenkins-hbase17:38115] zookeeper.ZKUtil(162): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:11,203 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 10:12:11,205 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 10:12:11,206 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 10:12:11,230 INFO [RS:0;jenkins-hbase17:35819] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 10:12:11,232 INFO [RS:2;jenkins-hbase17:38115] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 10:12:11,237 INFO [RS:1;jenkins-hbase17:42413] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 10:12:11,246 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:11,279 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 10:12:11,283 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/info 2023-07-21 10:12:11,284 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 10:12:11,287 INFO [RS:1;jenkins-hbase17:42413] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 10:12:11,287 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:11,288 INFO [RS:2;jenkins-hbase17:38115] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 10:12:11,296 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 10:12:11,303 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/rep_barrier 2023-07-21 10:12:11,291 INFO [RS:0;jenkins-hbase17:35819] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 10:12:11,304 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 10:12:11,305 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:11,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 10:12:11,307 INFO [RS:1;jenkins-hbase17:42413] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 10:12:11,309 INFO [RS:1;jenkins-hbase17:42413] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,312 INFO [RS:0;jenkins-hbase17:35819] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 10:12:11,307 INFO [RS:2;jenkins-hbase17:38115] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 10:12:11,312 INFO [RS:0;jenkins-hbase17:35819] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,313 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 10:12:11,314 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/table 2023-07-21 10:12:11,315 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 10:12:11,317 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:11,319 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 10:12:11,320 INFO [RS:2;jenkins-hbase17:38115] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,324 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740 2023-07-21 10:12:11,324 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 10:12:11,326 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740 2023-07-21 10:12:11,334 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 10:12:11,338 INFO [RS:0;jenkins-hbase17:35819] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,338 INFO [RS:2;jenkins-hbase17:38115] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,339 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,339 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,339 INFO [RS:1;jenkins-hbase17:42413] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,339 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,339 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,339 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,340 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-21 10:12:11,340 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,340 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,340 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,340 DEBUG [RS:0;jenkins-hbase17:35819] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,342 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 10:12:11,339 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,361 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,361 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,361 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,362 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,362 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-21 10:12:11,339 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,376 INFO [RS:0;jenkins-hbase17:35819] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,376 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,377 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,377 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,377 DEBUG [RS:2;jenkins-hbase17:38115] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,376 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,377 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,377 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,378 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,378 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase17:0, corePoolSize=2, maxPoolSize=2 2023-07-21 10:12:11,378 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,378 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,378 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,378 DEBUG [RS:1;jenkins-hbase17:42413] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase17:0, corePoolSize=1, maxPoolSize=1 2023-07-21 10:12:11,376 INFO [RS:0;jenkins-hbase17:35819] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,379 INFO [RS:0;jenkins-hbase17:35819] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,388 INFO [RS:2;jenkins-hbase17:38115] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,388 INFO [RS:2;jenkins-hbase17:38115] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,388 INFO [RS:2;jenkins-hbase17:38115] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,389 INFO [RS:1;jenkins-hbase17:42413] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,390 INFO [RS:1;jenkins-hbase17:42413] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,390 INFO [RS:1;jenkins-hbase17:42413] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,393 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:11,395 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73786897, jitterRate=0.09951044619083405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 10:12:11,395 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 10:12:11,395 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 10:12:11,395 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 10:12:11,395 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 10:12:11,396 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 10:12:11,396 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 10:12:11,397 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 10:12:11,405 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 10:12:11,417 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 10:12:11,417 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-21 10:12:11,424 INFO [RS:0;jenkins-hbase17:35819] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 10:12:11,427 INFO [RS:2;jenkins-hbase17:38115] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 10:12:11,431 INFO [RS:2;jenkins-hbase17:38115] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38115,1689934328849-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-21 10:12:11,432 INFO [RS:0;jenkins-hbase17:35819] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,35819,1689934328736-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,426 INFO [RS:1;jenkins-hbase17:42413] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 10:12:11,433 INFO [RS:1;jenkins-hbase17:42413] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,42413,1689934328803-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:11,475 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-21 10:12:11,483 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-21 10:12:11,496 INFO [RS:0;jenkins-hbase17:35819] regionserver.Replication(203): jenkins-hbase17.apache.org,35819,1689934328736 started 2023-07-21 10:12:11,496 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,35819,1689934328736, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:35819, sessionid=0x101875ce56c0001 2023-07-21 10:12:11,520 INFO [RS:2;jenkins-hbase17:38115] regionserver.Replication(203): jenkins-hbase17.apache.org,38115,1689934328849 started 2023-07-21 10:12:11,520 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,38115,1689934328849, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:38115, sessionid=0x101875ce56c0003 2023-07-21 10:12:11,521 DEBUG [RS:2;jenkins-hbase17:38115] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 10:12:11,521 DEBUG [RS:2;jenkins-hbase17:38115] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:11,521 DEBUG [RS:2;jenkins-hbase17:38115] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,38115,1689934328849' 2023-07-21 10:12:11,521 DEBUG [RS:2;jenkins-hbase17:38115] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 10:12:11,524 DEBUG [RS:0;jenkins-hbase17:35819] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 10:12:11,525 DEBUG [RS:2;jenkins-hbase17:38115] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 10:12:11,536 DEBUG [RS:2;jenkins-hbase17:38115] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 10:12:11,537 DEBUG [RS:2;jenkins-hbase17:38115] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 10:12:11,537 DEBUG [RS:2;jenkins-hbase17:38115] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:11,537 DEBUG [RS:2;jenkins-hbase17:38115] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,38115,1689934328849' 2023-07-21 10:12:11,537 DEBUG [RS:2;jenkins-hbase17:38115] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:11,538 DEBUG [RS:2;jenkins-hbase17:38115] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:11,538 DEBUG [RS:2;jenkins-hbase17:38115] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 10:12:11,539 INFO [RS:2;jenkins-hbase17:38115] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 10:12:11,539 INFO [RS:2;jenkins-hbase17:38115] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 10:12:11,524 DEBUG [RS:0;jenkins-hbase17:35819] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:11,541 INFO [RS:1;jenkins-hbase17:42413] regionserver.Replication(203): jenkins-hbase17.apache.org,42413,1689934328803 started 2023-07-21 10:12:11,541 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1637): Serving as jenkins-hbase17.apache.org,42413,1689934328803, RpcServer on jenkins-hbase17.apache.org/136.243.18.41:42413, sessionid=0x101875ce56c0002 2023-07-21 10:12:11,541 DEBUG [RS:1;jenkins-hbase17:42413] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 10:12:11,541 DEBUG [RS:1;jenkins-hbase17:42413] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:11,541 DEBUG [RS:0;jenkins-hbase17:35819] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35819,1689934328736' 2023-07-21 10:12:11,544 DEBUG [RS:0;jenkins-hbase17:35819] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 10:12:11,541 DEBUG [RS:1;jenkins-hbase17:42413] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,42413,1689934328803' 2023-07-21 10:12:11,545 DEBUG [RS:1;jenkins-hbase17:42413] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 10:12:11,545 DEBUG [RS:0;jenkins-hbase17:35819] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 10:12:11,548 DEBUG [RS:1;jenkins-hbase17:42413] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 10:12:11,549 DEBUG [RS:0;jenkins-hbase17:35819] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 10:12:11,549 DEBUG [RS:0;jenkins-hbase17:35819] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 10:12:11,549 DEBUG [RS:0;jenkins-hbase17:35819] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:11,550 DEBUG [RS:0;jenkins-hbase17:35819] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,35819,1689934328736' 2023-07-21 10:12:11,550 DEBUG [RS:0;jenkins-hbase17:35819] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:11,551 DEBUG [RS:1;jenkins-hbase17:42413] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 10:12:11,551 DEBUG [RS:0;jenkins-hbase17:35819] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:11,552 DEBUG [RS:0;jenkins-hbase17:35819] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 10:12:11,551 DEBUG [RS:1;jenkins-hbase17:42413] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 10:12:11,552 INFO [RS:0;jenkins-hbase17:35819] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 10:12:11,553 DEBUG [RS:1;jenkins-hbase17:42413] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:11,553 INFO [RS:0;jenkins-hbase17:35819] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 10:12:11,554 DEBUG [RS:1;jenkins-hbase17:42413] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase17.apache.org,42413,1689934328803' 2023-07-21 10:12:11,554 DEBUG [RS:1;jenkins-hbase17:42413] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:11,555 DEBUG [RS:1;jenkins-hbase17:42413] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:11,556 DEBUG [RS:1;jenkins-hbase17:42413] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 10:12:11,556 INFO [RS:1;jenkins-hbase17:42413] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 10:12:11,557 INFO [RS:1;jenkins-hbase17:42413] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 10:12:11,636 DEBUG [jenkins-hbase17:38671] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-21 10:12:11,647 DEBUG [jenkins-hbase17:38671] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:11,670 INFO [RS:0;jenkins-hbase17:35819] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35819%2C1689934328736, suffix=, logDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,35819,1689934328736, archiveDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/oldWALs, maxLogs=32 2023-07-21 10:12:11,675 DEBUG [jenkins-hbase17:38671] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:11,675 DEBUG [jenkins-hbase17:38671] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:11,675 DEBUG [jenkins-hbase17:38671] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:11,676 DEBUG [jenkins-hbase17:38671] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:11,679 INFO [RS:1;jenkins-hbase17:42413] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C42413%2C1689934328803, suffix=, logDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,42413,1689934328803, archiveDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/oldWALs, maxLogs=32 2023-07-21 10:12:11,700 INFO [RS:2;jenkins-hbase17:38115] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C38115%2C1689934328849, suffix=, logDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,38115,1689934328849, archiveDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/oldWALs, maxLogs=32 2023-07-21 10:12:11,709 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,35819,1689934328736, state=OPENING 2023-07-21 10:12:11,724 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-21 10:12:11,727 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:11,728 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 10:12:11,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:12:11,814 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK] 2023-07-21 10:12:11,814 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK] 2023-07-21 10:12:11,841 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK] 2023-07-21 10:12:11,842 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK] 2023-07-21 10:12:11,842 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK] 2023-07-21 10:12:11,843 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK] 2023-07-21 10:12:11,848 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK] 2023-07-21 10:12:11,849 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK] 2023-07-21 10:12:11,851 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK] 2023-07-21 10:12:11,885 INFO [RS:2;jenkins-hbase17:38115] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,38115,1689934328849/jenkins-hbase17.apache.org%2C38115%2C1689934328849.1689934331702 2023-07-21 10:12:11,889 DEBUG [RS:2;jenkins-hbase17:38115] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK], DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK], DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK]] 2023-07-21 10:12:11,897 INFO [RS:0;jenkins-hbase17:35819] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,35819,1689934328736/jenkins-hbase17.apache.org%2C35819%2C1689934328736.1689934331692 2023-07-21 10:12:11,898 INFO [RS:1;jenkins-hbase17:42413] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,42413,1689934328803/jenkins-hbase17.apache.org%2C42413%2C1689934328803.1689934331692 2023-07-21 10:12:11,899 DEBUG [RS:0;jenkins-hbase17:35819] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK], DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK], DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK]] 2023-07-21 10:12:11,929 DEBUG [RS:1;jenkins-hbase17:42413] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK], DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK], DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK]] 2023-07-21 10:12:12,072 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:12,081 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:12:12,126 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:12:12,167 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-21 10:12:12,167 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 10:12:12,175 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase17.apache.org%2C35819%2C1689934328736.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,35819,1689934328736, archiveDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/oldWALs, maxLogs=32 2023-07-21 10:12:12,264 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK] 2023-07-21 10:12:12,264 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK] 2023-07-21 10:12:12,286 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK] 2023-07-21 10:12:12,303 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/WALs/jenkins-hbase17.apache.org,35819,1689934328736/jenkins-hbase17.apache.org%2C35819%2C1689934328736.meta.1689934332179.meta 2023-07-21 10:12:12,306 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33027,DS-39c4e183-977e-4853-8485-26309790d6ac,DISK], DatanodeInfoWithStorage[127.0.0.1:41203,DS-6e5467f9-b022-4924-982e-eeba3cd3c35f,DISK], DatanodeInfoWithStorage[127.0.0.1:45209,DS-c0b44846-588c-46c8-b274-4abe87fb1d58,DISK]] 2023-07-21 10:12:12,307 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:12:12,308 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-21 10:12:12,310 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:12,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-21 10:12:12,314 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-21 10:12:12,316 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-21 10:12:12,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-21 10:12:12,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:12,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-21 10:12:12,338 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-21 10:12:12,345 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 10:12:12,352 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/info 2023-07-21 10:12:12,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/info 2023-07-21 10:12:12,387 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 10:12:12,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:12,395 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 10:12:12,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/rep_barrier 2023-07-21 10:12:12,401 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/rep_barrier 2023-07-21 10:12:12,402 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 10:12:12,404 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:12,404 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 10:12:12,407 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/table 2023-07-21 10:12:12,407 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/table 2023-07-21 10:12:12,408 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 10:12:12,409 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:12,411 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740 2023-07-21 10:12:12,416 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740 2023-07-21 10:12:12,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 10:12:12,436 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 10:12:12,439 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68745658, jitterRate=0.02439013123512268}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 10:12:12,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 10:12:12,461 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689934332061 2023-07-21 10:12:12,549 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-21 10:12:12,551 INFO [RS_OPEN_META-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-21 10:12:12,553 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase17.apache.org,35819,1689934328736, state=OPEN 2023-07-21 10:12:12,560 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-21 10:12:12,561 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 10:12:12,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-21 10:12:12,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase17.apache.org,35819,1689934328736 in 809 msec 2023-07-21 10:12:12,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-21 10:12:12,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.1380 sec 2023-07-21 10:12:12,606 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 2.1690 sec 2023-07-21 10:12:12,606 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689934332606, completionTime=-1 2023-07-21 10:12:12,607 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-21 10:12:12,607 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-21 10:12:12,741 DEBUG [hconnection-0x3fefe1fa-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:12,765 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:12,810 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-21 10:12:12,810 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689934392810 2023-07-21 10:12:12,811 INFO [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689934452810 2023-07-21 10:12:12,811 INFO [master/jenkins-hbase17:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 203 msec 2023-07-21 10:12:12,853 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38671,1689934327089-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:12,854 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38671,1689934327089-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:12,854 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38671,1689934327089-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:12,856 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase17:38671, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:12,872 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-21 10:12:12,879 DEBUG [master/jenkins-hbase17:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-21 10:12:12,893 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-21 10:12:12,895 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:12,912 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-21 10:12:12,916 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:12:12,925 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:12:12,963 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90 2023-07-21 10:12:12,968 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90 empty. 2023-07-21 10:12:12,971 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90 2023-07-21 10:12:12,971 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-21 10:12:13,088 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:13,091 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 585e96271ab8cbfacaf384e016deea90, NAME => 'hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:12:13,142 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:13,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 585e96271ab8cbfacaf384e016deea90, disabling compactions & flushes 2023-07-21 10:12:13,143 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:12:13,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:12:13,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. after waiting 0 ms 2023-07-21 10:12:13,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:12:13,143 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:12:13,143 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 585e96271ab8cbfacaf384e016deea90: 2023-07-21 10:12:13,154 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:12:13,193 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689934333159"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934333159"}]},"ts":"1689934333159"} 2023-07-21 10:12:13,260 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 10:12:13,267 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:12:13,275 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934333268"}]},"ts":"1689934333268"} 2023-07-21 10:12:13,282 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-21 10:12:13,289 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:13,292 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:13,292 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:13,292 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:13,292 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:13,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=585e96271ab8cbfacaf384e016deea90, ASSIGN}] 2023-07-21 10:12:13,307 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=585e96271ab8cbfacaf384e016deea90, ASSIGN 2023-07-21 10:12:13,309 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=585e96271ab8cbfacaf384e016deea90, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,42413,1689934328803; forceNewPlan=false, retain=false 2023-07-21 10:12:13,463 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 10:12:13,464 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=585e96271ab8cbfacaf384e016deea90, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:13,464 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689934333463"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934333463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934333463"}]},"ts":"1689934333463"} 2023-07-21 10:12:13,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 585e96271ab8cbfacaf384e016deea90, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:12:13,643 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:13,644 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:12:13,661 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:12:13,684 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:12:13,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 585e96271ab8cbfacaf384e016deea90, NAME => 'hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90.', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:12:13,685 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. service=AccessControlService 2023-07-21 10:12:13,688 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:13,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 585e96271ab8cbfacaf384e016deea90 2023-07-21 10:12:13,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:13,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 585e96271ab8cbfacaf384e016deea90 2023-07-21 10:12:13,689 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 585e96271ab8cbfacaf384e016deea90 2023-07-21 10:12:13,700 INFO [StoreOpener-585e96271ab8cbfacaf384e016deea90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 585e96271ab8cbfacaf384e016deea90 2023-07-21 10:12:13,709 DEBUG [StoreOpener-585e96271ab8cbfacaf384e016deea90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90/info 2023-07-21 10:12:13,710 DEBUG [StoreOpener-585e96271ab8cbfacaf384e016deea90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90/info 2023-07-21 10:12:13,714 INFO [StoreOpener-585e96271ab8cbfacaf384e016deea90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 585e96271ab8cbfacaf384e016deea90 columnFamilyName info 2023-07-21 10:12:13,715 INFO [StoreOpener-585e96271ab8cbfacaf384e016deea90-1] regionserver.HStore(310): Store=585e96271ab8cbfacaf384e016deea90/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:13,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90 2023-07-21 10:12:13,723 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90 2023-07-21 10:12:13,736 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 585e96271ab8cbfacaf384e016deea90 2023-07-21 10:12:13,742 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:13,743 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 585e96271ab8cbfacaf384e016deea90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74734111, jitterRate=0.11362503468990326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:13,744 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 585e96271ab8cbfacaf384e016deea90: 2023-07-21 10:12:13,749 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90., pid=6, masterSystemTime=1689934333643 2023-07-21 10:12:13,756 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:12:13,757 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:12:13,760 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=585e96271ab8cbfacaf384e016deea90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:13,760 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689934333759"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934333759"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934333759"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934333759"}]},"ts":"1689934333759"} 2023-07-21 10:12:13,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-21 10:12:13,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 585e96271ab8cbfacaf384e016deea90, server=jenkins-hbase17.apache.org,42413,1689934328803 in 296 msec 2023-07-21 10:12:13,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-21 10:12:13,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=585e96271ab8cbfacaf384e016deea90, ASSIGN in 471 msec 2023-07-21 10:12:13,783 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:12:13,783 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934333783"}]},"ts":"1689934333783"} 2023-07-21 10:12:13,786 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-21 10:12:13,791 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:12:13,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 893 msec 2023-07-21 10:12:13,828 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-21 10:12:13,833 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-21 10:12:13,833 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:13,884 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:13,891 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:13,910 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-21 10:12:13,953 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 10:12:13,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 65 msec 2023-07-21 10:12:13,972 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-21 10:12:14,011 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 10:12:14,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 46 msec 2023-07-21 10:12:14,032 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-21 10:12:14,033 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-21 10:12:14,035 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 5.097sec 2023-07-21 10:12:14,038 INFO [master/jenkins-hbase17:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-21 10:12:14,040 INFO [master/jenkins-hbase17:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-21 10:12:14,040 INFO [master/jenkins-hbase17:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-21 10:12:14,041 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38671,1689934327089-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-21 10:12:14,042 INFO [master/jenkins-hbase17:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase17.apache.org,38671,1689934327089-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-21 10:12:14,062 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:14,064 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-21 10:12:14,066 DEBUG [Listener at localhost.localdomain/36149] zookeeper.ReadOnlyZKClient(139): Connect 0x3505e662 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:14,068 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:12:14,072 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:12:14,073 DEBUG [Listener at localhost.localdomain/36149] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b4b0dac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:14,114 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:12:14,117 INFO [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-21 10:12:14,117 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937 empty. 2023-07-21 10:12:14,140 DEBUG [hconnection-0x9eb5fc8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:14,141 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:14,144 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:12:14,144 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-21 10:12:14,162 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:14,165 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:12:14,165 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-21 10:12:14,166 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/test.cache.data in system properties and HBase conf 2023-07-21 10:12:14,166 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 10:12:14,166 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop.log.dir in system properties and HBase conf 2023-07-21 10:12:14,166 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 10:12:14,166 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 10:12:14,166 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 10:12:14,167 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 10:12:14,167 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 10:12:14,167 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 10:12:14,167 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 10:12:14,167 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 10:12:14,167 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 10:12:14,168 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 10:12:14,168 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 10:12:14,168 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 10:12:14,168 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/nfs.dump.dir in system properties and HBase conf 2023-07-21 10:12:14,168 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir in system properties and HBase conf 2023-07-21 10:12:14,168 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 10:12:14,168 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 10:12:14,168 INFO [Listener at localhost.localdomain/36149] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-21 10:12:14,235 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:14,238 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => a39a9244d3af3210798aa1f983e4d937, NAME => 'hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:12:14,246 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:14,310 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:14,315 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing a39a9244d3af3210798aa1f983e4d937, disabling compactions & flushes 2023-07-21 10:12:14,315 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:12:14,315 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:12:14,315 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. after waiting 0 ms 2023-07-21 10:12:14,316 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:12:14,316 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:12:14,316 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for a39a9244d3af3210798aa1f983e4d937: 2023-07-21 10:12:14,337 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:12:14,341 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689934334340"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934334340"}]},"ts":"1689934334340"} 2023-07-21 10:12:14,347 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 10:12:14,353 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:12:14,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934334353"}]},"ts":"1689934334353"} 2023-07-21 10:12:14,359 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-21 10:12:14,365 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:14,367 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:14,367 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:14,367 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:14,367 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:14,367 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a39a9244d3af3210798aa1f983e4d937, ASSIGN}] 2023-07-21 10:12:14,374 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=a39a9244d3af3210798aa1f983e4d937, ASSIGN 2023-07-21 10:12:14,381 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=a39a9244d3af3210798aa1f983e4d937, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38115,1689934328849; forceNewPlan=false, retain=false 2023-07-21 10:12:14,447 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:14,532 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 10:12:14,533 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a39a9244d3af3210798aa1f983e4d937, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:14,534 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689934334533"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934334533"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934334533"}]},"ts":"1689934334533"} 2023-07-21 10:12:14,538 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a39a9244d3af3210798aa1f983e4d937, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:12:14,695 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:14,695 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:12:14,697 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:59874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:12:14,708 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:12:14,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a39a9244d3af3210798aa1f983e4d937, NAME => 'hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937.', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:12:14,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. service=AccessControlService 2023-07-21 10:12:14,709 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:14,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:12:14,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:14,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:12:14,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:12:14,720 INFO [StoreOpener-a39a9244d3af3210798aa1f983e4d937-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:12:14,729 DEBUG [StoreOpener-a39a9244d3af3210798aa1f983e4d937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937/l 2023-07-21 10:12:14,729 DEBUG [StoreOpener-a39a9244d3af3210798aa1f983e4d937-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937/l 2023-07-21 10:12:14,730 INFO [StoreOpener-a39a9244d3af3210798aa1f983e4d937-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a39a9244d3af3210798aa1f983e4d937 columnFamilyName l 2023-07-21 10:12:14,732 INFO [StoreOpener-a39a9244d3af3210798aa1f983e4d937-1] regionserver.HStore(310): Store=a39a9244d3af3210798aa1f983e4d937/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:14,747 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:14,749 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:12:14,755 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:12:14,764 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:12:14,785 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:14,786 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened a39a9244d3af3210798aa1f983e4d937; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71010384, jitterRate=0.05813717842102051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:14,787 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for a39a9244d3af3210798aa1f983e4d937: 2023-07-21 10:12:14,791 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937., pid=11, masterSystemTime=1689934334695 2023-07-21 10:12:14,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:12:14,802 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:12:14,802 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a39a9244d3af3210798aa1f983e4d937, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:14,803 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689934334802"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934334802"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934334802"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934334802"}]},"ts":"1689934334802"} 2023-07-21 10:12:14,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-21 10:12:14,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a39a9244d3af3210798aa1f983e4d937, server=jenkins-hbase17.apache.org,38115,1689934328849 in 268 msec 2023-07-21 10:12:14,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-21 10:12:14,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=a39a9244d3af3210798aa1f983e4d937, ASSIGN in 449 msec 2023-07-21 10:12:14,825 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:12:14,825 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934334825"}]},"ts":"1689934334825"} 2023-07-21 10:12:14,828 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-21 10:12:14,921 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:12:14,931 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 860 msec 2023-07-21 10:12:15,254 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 10:12:15,254 INFO [master/jenkins-hbase17:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-21 10:12:15,283 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-21 10:12:16,116 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:16,459 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:16,465 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_40975_jobhistory____g1k0vk/webapp 2023-07-21 10:12:16,655 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-21 10:12:16,655 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-21 10:12:16,655 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 10:12:16,659 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 10:12:16,750 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:17,077 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:17,219 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-21 10:12:17,221 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-21 10:12:17,224 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-21 10:12:17,297 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:17,297 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-21 10:12:17,298 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:17,298 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-21 10:12:17,298 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 10:12:17,298 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-21 10:12:17,298 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:17,298 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-21 10:12:17,299 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 10:12:17,299 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-21 10:12:17,676 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-21 10:12:17,730 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:40975 2023-07-21 10:12:18,078 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:12:19,064 WARN [Listener at jenkins-hbase17.apache.org/41571] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:19,182 WARN [Listener at jenkins-hbase17.apache.org/41571] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 10:12:19,184 INFO [Listener at jenkins-hbase17.apache.org/41571] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:19,209 INFO [Listener at jenkins-hbase17.apache.org/41571] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_43861_cluster____vurbvo/webapp 2023-07-21 10:12:19,333 INFO [Listener at jenkins-hbase17.apache.org/41571] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 10:12:19,333 INFO [Listener at jenkins-hbase17.apache.org/41571] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-21 10:12:19,334 INFO [Listener at jenkins-hbase17.apache.org/41571] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 10:12:19,339 INFO [Listener at jenkins-hbase17.apache.org/41571] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 10:12:19,361 INFO [Listener at jenkins-hbase17.apache.org/41571] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:19,670 INFO [Listener at jenkins-hbase17.apache.org/41571] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:19,859 INFO [Listener at jenkins-hbase17.apache.org/41571] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:19,886 INFO [Listener at jenkins-hbase17.apache.org/41571] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:43861 2023-07-21 10:12:21,021 WARN [Listener at jenkins-hbase17.apache.org/46883] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:21,046 WARN [Listener at jenkins-hbase17.apache.org/46883] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 10:12:21,046 INFO [Listener at jenkins-hbase17.apache.org/46883] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:21,053 INFO [Listener at jenkins-hbase17.apache.org/46883] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_37767_node____.7ibxky/webapp 2023-07-21 10:12:21,113 INFO [Listener at jenkins-hbase17.apache.org/46883] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 10:12:21,114 INFO [Listener at jenkins-hbase17.apache.org/46883] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 10:12:21,114 INFO [Listener at jenkins-hbase17.apache.org/46883] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 10:12:21,114 INFO [Listener at jenkins-hbase17.apache.org/46883] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 10:12:21,127 INFO [Listener at jenkins-hbase17.apache.org/46883] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:21,154 INFO [Listener at jenkins-hbase17.apache.org/46883] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:21,256 INFO [Listener at jenkins-hbase17.apache.org/46883] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:21,296 INFO [Listener at jenkins-hbase17.apache.org/46883] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:37767 2023-07-21 10:12:21,978 WARN [Listener at jenkins-hbase17.apache.org/33881] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 10:12:21,998 WARN [Listener at jenkins-hbase17.apache.org/33881] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 10:12:21,998 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 10:12:22,020 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/java.io.tmpdir/Jetty_jenkins.hbase17_apache_org_40807_node____xi9jcd/webapp 2023-07-21 10:12:22,090 INFO [Listener at jenkins-hbase17.apache.org/33881] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 10:12:22,090 INFO [Listener at jenkins-hbase17.apache.org/33881] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 10:12:22,090 INFO [Listener at jenkins-hbase17.apache.org/33881] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 10:12:22,090 INFO [Listener at jenkins-hbase17.apache.org/33881] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 10:12:22,115 INFO [Listener at jenkins-hbase17.apache.org/33881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:22,135 INFO [Listener at jenkins-hbase17.apache.org/33881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:22,232 INFO [Listener at jenkins-hbase17.apache.org/33881] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 10:12:22,239 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:40807 2023-07-21 10:12:22,269 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-21 10:12:22,271 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:22,368 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=709, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=657, ProcessCount=187, AvailableMemoryMB=1508 2023-07-21 10:12:22,368 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=709 is superior to 500 2023-07-21 10:12:22,390 DEBUG [Listener at jenkins-hbase17.apache.org/33881] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 10:12:22,424 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-21 10:12:22,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:22,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:22,451 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:12:22,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:12:22,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-21 10:12:22,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:22,463 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:22,467 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:22,467 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d empty. 2023-07-21 10:12:22,469 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144 empty. 2023-07-21 10:12:22,472 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:22,479 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:22,479 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 10:12:22,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:22,608 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:22,610 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 21cbc534fc08c9665ae415531e1aac3d, NAME => 'testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:12:22,611 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => de9a7f0f4b416e23a8ad76eea278d144, NAME => 'testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:12:22,725 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:22,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 21cbc534fc08c9665ae415531e1aac3d, disabling compactions & flushes 2023-07-21 10:12:22,728 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:22,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:22,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. after waiting 0 ms 2023-07-21 10:12:22,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:22,728 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:22,728 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 21cbc534fc08c9665ae415531e1aac3d: 2023-07-21 10:12:22,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:23,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:23,127 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:23,127 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing de9a7f0f4b416e23a8ad76eea278d144, disabling compactions & flushes 2023-07-21 10:12:23,128 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:23,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:23,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. after waiting 0 ms 2023-07-21 10:12:23,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:23,128 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:23,128 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for de9a7f0f4b416e23a8ad76eea278d144: 2023-07-21 10:12:23,133 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:12:23,135 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934343134"}]},"ts":"1689934343134"} 2023-07-21 10:12:23,135 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934343134"}]},"ts":"1689934343134"} 2023-07-21 10:12:23,193 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:12:23,196 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:12:23,196 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934343196"}]},"ts":"1689934343196"} 2023-07-21 10:12:23,199 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-21 10:12:23,210 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:23,215 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:23,215 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:23,215 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:23,216 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:23,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=21cbc534fc08c9665ae415531e1aac3d, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=de9a7f0f4b416e23a8ad76eea278d144, ASSIGN}] 2023-07-21 10:12:23,226 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=21cbc534fc08c9665ae415531e1aac3d, ASSIGN 2023-07-21 10:12:23,226 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=de9a7f0f4b416e23a8ad76eea278d144, ASSIGN 2023-07-21 10:12:23,233 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=21cbc534fc08c9665ae415531e1aac3d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38115,1689934328849; forceNewPlan=false, retain=false 2023-07-21 10:12:23,234 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=de9a7f0f4b416e23a8ad76eea278d144, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,42413,1689934328803; forceNewPlan=false, retain=false 2023-07-21 10:12:23,383 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:12:23,386 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=de9a7f0f4b416e23a8ad76eea278d144, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:23,386 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=21cbc534fc08c9665ae415531e1aac3d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:23,387 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343386"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934343386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934343386"}]},"ts":"1689934343386"} 2023-07-21 10:12:23,387 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343386"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934343386"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934343386"}]},"ts":"1689934343386"} 2023-07-21 10:12:23,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 21cbc534fc08c9665ae415531e1aac3d, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:12:23,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure de9a7f0f4b416e23a8ad76eea278d144, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:12:23,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:23,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 21cbc534fc08c9665ae415531e1aac3d, NAME => 'testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:12:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. service=AccessControlService 2023-07-21 10:12:23,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:23,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:23,553 INFO [StoreOpener-21cbc534fc08c9665ae415531e1aac3d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:23,555 DEBUG [StoreOpener-21cbc534fc08c9665ae415531e1aac3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/cf 2023-07-21 10:12:23,555 DEBUG [StoreOpener-21cbc534fc08c9665ae415531e1aac3d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/cf 2023-07-21 10:12:23,556 INFO [StoreOpener-21cbc534fc08c9665ae415531e1aac3d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21cbc534fc08c9665ae415531e1aac3d columnFamilyName cf 2023-07-21 10:12:23,556 INFO [StoreOpener-21cbc534fc08c9665ae415531e1aac3d-1] regionserver.HStore(310): Store=21cbc534fc08c9665ae415531e1aac3d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:23,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:23,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:23,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:23,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:23,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => de9a7f0f4b416e23a8ad76eea278d144, NAME => 'testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:12:23,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. service=AccessControlService 2023-07-21 10:12:23,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:23,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:23,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:23,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:23,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:23,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:23,577 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 21cbc534fc08c9665ae415531e1aac3d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73581779, jitterRate=0.0964539498090744}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:23,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 21cbc534fc08c9665ae415531e1aac3d: 2023-07-21 10:12:23,579 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d., pid=15, masterSystemTime=1689934343544 2023-07-21 10:12:23,580 INFO [StoreOpener-de9a7f0f4b416e23a8ad76eea278d144-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:23,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:23,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:23,582 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=21cbc534fc08c9665ae415531e1aac3d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:23,582 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343582"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934343582"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934343582"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934343582"}]},"ts":"1689934343582"} 2023-07-21 10:12:23,583 DEBUG [StoreOpener-de9a7f0f4b416e23a8ad76eea278d144-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/cf 2023-07-21 10:12:23,583 DEBUG [StoreOpener-de9a7f0f4b416e23a8ad76eea278d144-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/cf 2023-07-21 10:12:23,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:23,585 INFO [StoreOpener-de9a7f0f4b416e23a8ad76eea278d144-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de9a7f0f4b416e23a8ad76eea278d144 columnFamilyName cf 2023-07-21 10:12:23,586 INFO [StoreOpener-de9a7f0f4b416e23a8ad76eea278d144-1] regionserver.HStore(310): Store=de9a7f0f4b416e23a8ad76eea278d144/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:23,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:23,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:23,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-21 10:12:23,593 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 21cbc534fc08c9665ae415531e1aac3d, server=jenkins-hbase17.apache.org,38115,1689934328849 in 196 msec 2023-07-21 10:12:23,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=21cbc534fc08c9665ae415531e1aac3d, ASSIGN in 377 msec 2023-07-21 10:12:23,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:23,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:23,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened de9a7f0f4b416e23a8ad76eea278d144; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59066175, jitterRate=-0.11984540522098541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:23,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for de9a7f0f4b416e23a8ad76eea278d144: 2023-07-21 10:12:23,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144., pid=16, masterSystemTime=1689934343562 2023-07-21 10:12:23,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:23,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:23,614 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=de9a7f0f4b416e23a8ad76eea278d144, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:23,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934343614"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934343614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934343614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934343614"}]},"ts":"1689934343614"} 2023-07-21 10:12:23,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-21 10:12:23,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure de9a7f0f4b416e23a8ad76eea278d144, server=jenkins-hbase17.apache.org,42413,1689934328803 in 224 msec 2023-07-21 10:12:23,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-21 10:12:23,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=de9a7f0f4b416e23a8ad76eea278d144, ASSIGN in 410 msec 2023-07-21 10:12:23,634 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:12:23,634 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934343634"}]},"ts":"1689934343634"} 2023-07-21 10:12:23,636 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-21 10:12:23,639 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:12:23,644 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-21 10:12:23,650 DEBUG [PEWorker-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:23,654 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:23,658 DEBUG [hconnection-0x4dba7098-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:23,663 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-21 10:12:23,672 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 10:12:23,699 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:23,699 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:23,699 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:23,700 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:12:23,700 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:23,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:23,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:23,709 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:23,710 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:23,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.2690 sec 2023-07-21 10:12:24,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 10:12:24,588 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-21 10:12:24,588 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-21 10:12:24,589 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:24,596 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-21 10:12:24,596 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:24,597 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-21 10:12:24,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:24,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934344616 (current time:1689934344616). 2023-07-21 10:12:24,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:12:24,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x7e6fa5ae to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:24,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@374ea211, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:24,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:24,631 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:24,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e6fa5ae to 127.0.0.1:60277 2023-07-21 10:12:24,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:24,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x7894b137 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:24,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24131460, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:24,742 DEBUG [hconnection-0x59e68837-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:24,743 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:24,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:24,753 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:24,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7894b137 to 127.0.0.1:60277 2023-07-21 10:12:24,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:24,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 10:12:24,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:12:24,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:24,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:24,802 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:24,803 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689934944803 2023-07-21 10:12:24,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:24,803 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 10:12:24,807 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:24,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:24,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-21 10:12:24,811 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:24,812 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:12:24,812 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:12:24,812 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689934944812 2023-07-21 10:12:24,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,844 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-21 10:12:24,844 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:24,846 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 10:12:24,846 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 10:12:24,862 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,862 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,865 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:24,865 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:24,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:24,865 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:24,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:24,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:24,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:24,865 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:24,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:24,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,866 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:24,866 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 10:12:24,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,867 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:24,867 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:12:24,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 10:12:24,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:24,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,867 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 10:12:24,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,868 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:24,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,871 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:24,871 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:24,871 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:24,871 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:24,871 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:24,871 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:24,875 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:24,875 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:24,875 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:24,875 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:24,875 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:24,875 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:24,879 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:24,879 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:24,879 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:24,884 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,884 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:24,884 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:24,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:24,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:24,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:24,886 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,886 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:24,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:24,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:24,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:24,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 10:12:24,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e8f405a[Count = 1] remaining members to acquire global barrier 2023-07-21 10:12:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:24,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:24,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:24,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:24,886 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,891 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:24,887 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:24,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:24,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 10:12:24,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e8f405a[Count = 0] remaining members to acquire global barrier 2023-07-21 10:12:24,893 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 10:12:24,893 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,895 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,895 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:24,896 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,896 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,896 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:24,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,897 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:24,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,897 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:24,897 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:12:24,898 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:24,900 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,901 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:24,901 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:24,901 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:24,901 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:24,901 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:24,901 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:12:24,901 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. started... 2023-07-21 10:12:24,902 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:24,902 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:24,902 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:24,902 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. started... 2023-07-21 10:12:24,910 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:24,910 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:24,910 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de9a7f0f4b416e23a8ad76eea278d144: 2023-07-21 10:12:24,910 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:24,912 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,912 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:24,916 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21cbc534fc08c9665ae415531e1aac3d: 2023-07-21 10:12:24,916 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:24,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:24,919 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:24,919 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:24,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:24,920 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:12:24,923 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:12:24,923 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:12:25,027 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. completed. 2023-07-21 10:12:25,028 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:25,028 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:25,028 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:25,029 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,029 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:25,029 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:12:25,030 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. completed. 2023-07-21 10:12:25,030 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:25,031 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:25,031 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:25,031 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,031 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:25,031 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:12:25,032 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,032 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,032 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:25,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:25,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:25,034 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,032 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:25,034 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:25,034 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:25,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:25,034 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:25,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:25,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:25,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:12:25,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 10:12:25,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:25,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:25,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:25,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:25,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,42413,1689934328803': 2023-07-21 10:12:25,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 10:12:25,049 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-21 10:12:25,049 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:12:25,049 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:12:25,050 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,050 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:12:25,052 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,052 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,052 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,052 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,052 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,053 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:25,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,053 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,054 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,054 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,055 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:25,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,062 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,062 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,063 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:25,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,120 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:25,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:25,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:25,122 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:12:25,271 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:25,271 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:25,271 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:25,271 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,271 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:25,271 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:25,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:25,271 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:25,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:25,271 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,271 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:25,271 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:25,273 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:25,273 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,273 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:25,273 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,273 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:25,273 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:25,274 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,274 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:25,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:25,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,423 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:25,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:25,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:25,425 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:12:25,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,638 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 10:12:25,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,639 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:25,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689934344803Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689934345273 (+470 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689934345273Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689934345357 (+84 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689934345416 (+59 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689934345638 (+222 ms) 2023-07-21 10:12:25,643 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:25,660 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 838 msec 2023-07-21 10:12:25,925 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:25,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:25,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:12:25,956 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:25,961 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:25,965 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:49088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:25,970 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:25,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38115] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:12:25,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42413] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:12:25,981 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-21 10:12:25,982 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:25,985 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:26,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:26,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934346033 (current time:1689934346033). 2023-07-21 10:12:26,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:12:26,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x28610cbc to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:26,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f12c59f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:26,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:26,060 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:26,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28610cbc to 127.0.0.1:60277 2023-07-21 10:12:26,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:26,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x339074c0 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:26,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13b49ae2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:26,116 DEBUG [hconnection-0x7a639b36-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:26,121 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:44220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:26,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:26,130 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:35114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:26,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x339074c0 to 127.0.0.1:60277 2023-07-21 10:12:26,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:26,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 10:12:26,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:12:26,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:26,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:26,143 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:26,144 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689934946144 2023-07-21 10:12:26,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 10:12:26,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 10:12:26,146 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:12:26,147 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:12:26,149 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 10:12:26,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:26,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-21 10:12:26,154 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:26,155 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689934946155 2023-07-21 10:12:26,248 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:26,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:26,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:26,250 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:12:26,450 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:26,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:26,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:26,453 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:12:26,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-21 10:12:26,596 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-21 10:12:26,596 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:26,596 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 10:12:26,596 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 10:12:26,597 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,597 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,601 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:26,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:26,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:26,604 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:26,604 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,604 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:26,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:26,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,605 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,605 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 10:12:26,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,609 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:26,609 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,609 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:12:26,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 10:12:26,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,610 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:26,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 10:12:26,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,610 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 10:12:26,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 10:12:26,612 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:26,612 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:26,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 10:12:26,612 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:26,612 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:26,621 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:26,621 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:26,621 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:26,621 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:26,621 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 10:12:26,621 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:26,621 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 10:12:26,622 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:26,622 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:26,623 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 10:12:26,623 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 10:12:26,623 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 10:12:26,625 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,625 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,626 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,626 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:26,626 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,626 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,626 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,626 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,626 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:26,626 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:26,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:26,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:26,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:26,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 10:12:26,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3785c4f0[Count = 1] remaining members to acquire global barrier 2023-07-21 10:12:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:26,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:26,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:26,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:26,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 10:12:26,638 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 10:12:26,638 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3785c4f0[Count = 0] remaining members to acquire global barrier 2023-07-21 10:12:26,638 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:26,641 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:26,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,641 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:26,642 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 10:12:26,642 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:26,642 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:26,642 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:26,642 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,642 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. started... 2023-07-21 10:12:26,642 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:26,642 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:26,642 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:12:26,642 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:26,642 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:12:26,642 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. started... 2023-07-21 10:12:26,642 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 21cbc534fc08c9665ae415531e1aac3d 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-21 10:12:26,642 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2745): Flushing de9a7f0f4b416e23a8ad76eea278d144 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-21 10:12:26,645 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:26,645 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:26,645 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:26,754 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:26,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:26,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:26,756 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:12:26,760 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/.tmp/cf/43bcf343c49f4f3e9dd615a790c94326 2023-07-21 10:12:26,770 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/.tmp/cf/9f8a19cf5e88468086483ec48b04ce12 2023-07-21 10:12:26,822 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/.tmp/cf/9f8a19cf5e88468086483ec48b04ce12 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/cf/9f8a19cf5e88468086483ec48b04ce12 2023-07-21 10:12:26,824 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/.tmp/cf/43bcf343c49f4f3e9dd615a790c94326 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/cf/43bcf343c49f4f3e9dd615a790c94326 2023-07-21 10:12:26,832 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/cf/9f8a19cf5e88468086483ec48b04ce12, entries=4, sequenceid=6, filesize=5.1 K 2023-07-21 10:12:26,834 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/cf/43bcf343c49f4f3e9dd615a790c94326, entries=46, sequenceid=6, filesize=7.9 K 2023-07-21 10:12:26,837 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 21cbc534fc08c9665ae415531e1aac3d in 195ms, sequenceid=6, compaction requested=false 2023-07-21 10:12:26,841 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-21 10:12:26,842 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21cbc534fc08c9665ae415531e1aac3d: 2023-07-21 10:12:26,842 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for de9a7f0f4b416e23a8ad76eea278d144 in 200ms, sequenceid=6, compaction requested=false 2023-07-21 10:12:26,843 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for de9a7f0f4b416e23a8ad76eea278d144: 2023-07-21 10:12:26,844 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 10:12:26,844 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 10:12:26,844 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:26,844 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:26,844 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/cf/43bcf343c49f4f3e9dd615a790c94326] hfiles 2023-07-21 10:12:26,844 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/cf/9f8a19cf5e88468086483ec48b04ce12] hfiles 2023-07-21 10:12:26,844 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/cf/43bcf343c49f4f3e9dd615a790c94326 for snapshot=snaptb0-testExportWithTargetName 2023-07-21 10:12:26,844 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/cf/9f8a19cf5e88468086483ec48b04ce12 for snapshot=snaptb0-testExportWithTargetName 2023-07-21 10:12:26,885 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. completed. 2023-07-21 10:12:26,885 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:26,885 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. completed. 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:26,885 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 10:12:26,885 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:12:26,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,886 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:26,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:26,887 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:26,887 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:26,888 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,888 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 10:12:26,888 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:26,888 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 10:12:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,42413,1689934328803': 2023-07-21 10:12:26,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 10:12:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:26,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:12:26,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 10:12:26,897 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-21 10:12:26,897 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:12:26,897 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:12:26,897 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-21 10:12:26,897 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:12:26,898 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,898 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,898 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:26,898 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,898 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,898 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,899 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:26,899 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:26,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:26,900 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:26,900 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:26,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,904 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:26,905 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 10:12:26,905 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,919 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,920 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,920 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,920 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,920 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:26,920 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-21 10:12:26,920 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-21 10:12:26,920 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:26,920 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,920 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:26,920 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:26,922 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,922 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,922 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:26,922 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:26,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:26,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:26,922 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:26,922 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:26,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:26,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 10:12:26,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:26,923 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:26,923 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:26,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:26,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:26,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 10:12:27,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,079 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 10:12:27,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689934346144Consolidate snapshot: snaptb0-testExportWithTargetName at 1689934346920 (+776 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689934346922 (+2 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689934346931 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689934346962 (+31 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689934347077 (+115 ms) 2023-07-21 10:12:27,082 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 10:12:27,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 936 msec 2023-07-21 10:12:27,258 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:27,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 10:12:27,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:12:27,262 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262 2023-07-21 10:12:27,262 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46589, tgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262, rawTgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262, srcFsUri=hdfs://localhost.localdomain:46589, srcDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:12:27,310 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:12:27,310 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-394767785_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 10:12:27,311 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a, snapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-21 10:12:27,345 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 10:12:27,462 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,463 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,464 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,464 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,465 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,465 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,465 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,557 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop-7693696199834869939.jar 2023-07-21 10:12:27,557 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,558 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,558 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,559 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,559 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,560 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:27,560 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:12:27,561 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:12:27,562 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:12:27,563 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:12:27,564 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:12:27,564 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:12:27,565 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:12:27,569 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:12:27,569 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:12:27,570 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:12:27,574 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:27,574 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:27,574 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:27,575 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:27,575 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:27,576 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:27,576 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:28,808 WARN [Listener at jenkins-hbase17.apache.org/33881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:12:28,820 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-21 10:12:28,833 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 10:12:29,232 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:12:29,474 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:12:29,474 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:12:30,060 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:36,878 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:39,295 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:44,695 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:46,002 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:12:46,003 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:12:46,013 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-21 10:12:46,013 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:12:46,014 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:12:46,014 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 10:12:46,017 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-21 10:12:46,017 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-21 10:12:46,017 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262/.hbase-snapshot/testExportWithTargetName at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262/.hbase-snapshot/testExportWithTargetName 2023-07-21 10:12:46,018 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-21 10:12:46,018 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934347262/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-21 10:12:46,030 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-21 10:12:46,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportWithTargetName 2023-07-21 10:12:46,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:46,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:46,057 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934366057"}]},"ts":"1689934366057"} 2023-07-21 10:12:46,059 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-21 10:12:46,128 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-21 10:12:46,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=21cbc534fc08c9665ae415531e1aac3d, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=de9a7f0f4b416e23a8ad76eea278d144, UNASSIGN}] 2023-07-21 10:12:46,134 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=21cbc534fc08c9665ae415531e1aac3d, UNASSIGN 2023-07-21 10:12:46,134 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=de9a7f0f4b416e23a8ad76eea278d144, UNASSIGN 2023-07-21 10:12:46,135 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=de9a7f0f4b416e23a8ad76eea278d144, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:46,135 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=21cbc534fc08c9665ae415531e1aac3d, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:46,136 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934366135"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934366135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934366135"}]},"ts":"1689934366135"} 2023-07-21 10:12:46,136 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934366135"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934366135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934366135"}]},"ts":"1689934366135"} 2023-07-21 10:12:46,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 21cbc534fc08c9665ae415531e1aac3d, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:12:46,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure de9a7f0f4b416e23a8ad76eea278d144, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:12:46,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:46,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:46,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:46,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing de9a7f0f4b416e23a8ad76eea278d144, disabling compactions & flushes 2023-07-21 10:12:46,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 21cbc534fc08c9665ae415531e1aac3d, disabling compactions & flushes 2023-07-21 10:12:46,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:46,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:46,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:46,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:46,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. after waiting 0 ms 2023-07-21 10:12:46,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. after waiting 0 ms 2023-07-21 10:12:46,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:46,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:46,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:12:46,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:12:46,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:46,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:12:46,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144. 2023-07-21 10:12:46,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d. 2023-07-21 10:12:46,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for de9a7f0f4b416e23a8ad76eea278d144: 2023-07-21 10:12:46,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 21cbc534fc08c9665ae415531e1aac3d: 2023-07-21 10:12:46,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:46,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=de9a7f0f4b416e23a8ad76eea278d144, regionState=CLOSED 2023-07-21 10:12:46,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:46,333 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934366333"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934366333"}]},"ts":"1689934366333"} 2023-07-21 10:12:46,334 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=21cbc534fc08c9665ae415531e1aac3d, regionState=CLOSED 2023-07-21 10:12:46,335 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689934366334"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934366334"}]},"ts":"1689934366334"} 2023-07-21 10:12:46,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-21 10:12:46,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure de9a7f0f4b416e23a8ad76eea278d144, server=jenkins-hbase17.apache.org,42413,1689934328803 in 195 msec 2023-07-21 10:12:46,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=de9a7f0f4b416e23a8ad76eea278d144, UNASSIGN in 207 msec 2023-07-21 10:12:46,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-21 10:12:46,354 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 21cbc534fc08c9665ae415531e1aac3d, server=jenkins-hbase17.apache.org,38115,1689934328849 in 199 msec 2023-07-21 10:12:46,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:46,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-21 10:12:46,374 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=21cbc534fc08c9665ae415531e1aac3d, UNASSIGN in 224 msec 2023-07-21 10:12:46,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934366376"}]},"ts":"1689934366376"} 2023-07-21 10:12:46,378 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-21 10:12:46,661 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-21 10:12:46,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:46,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 624 msec 2023-07-21 10:12:47,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 10:12:47,163 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-21 10:12:47,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportWithTargetName 2023-07-21 10:12:47,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:47,177 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:47,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-21 10:12:47,180 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:47,182 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-21 10:12:47,186 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:47,186 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:47,190 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/recovered.edits] 2023-07-21 10:12:47,190 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/recovered.edits] 2023-07-21 10:12:47,200 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/cf/43bcf343c49f4f3e9dd615a790c94326 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/cf/43bcf343c49f4f3e9dd615a790c94326 2023-07-21 10:12:47,200 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/cf/9f8a19cf5e88468086483ec48b04ce12 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/cf/9f8a19cf5e88468086483ec48b04ce12 2023-07-21 10:12:47,204 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d/recovered.edits/9.seqid 2023-07-21 10:12:47,204 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144/recovered.edits/9.seqid 2023-07-21 10:12:47,207 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/21cbc534fc08c9665ae415531e1aac3d 2023-07-21 10:12:47,207 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportWithTargetName/de9a7f0f4b416e23a8ad76eea278d144 2023-07-21 10:12:47,207 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 10:12:47,210 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:47,232 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-21 10:12:47,235 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-21 10:12:47,237 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:47,237 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-21 10:12:47,237 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934367237"}]},"ts":"9223372036854775807"} 2023-07-21 10:12:47,237 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934367237"}]},"ts":"9223372036854775807"} 2023-07-21 10:12:47,240 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:12:47,240 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 21cbc534fc08c9665ae415531e1aac3d, NAME => 'testtb-testExportWithTargetName,,1689934342438.21cbc534fc08c9665ae415531e1aac3d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => de9a7f0f4b416e23a8ad76eea278d144, NAME => 'testtb-testExportWithTargetName,1,1689934342438.de9a7f0f4b416e23a8ad76eea278d144.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:12:47,240 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-21 10:12:47,240 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934367240"}]},"ts":"9223372036854775807"} 2023-07-21 10:12:47,242 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-21 10:12:47,358 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 10:12:47,360 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 189 msec 2023-07-21 10:12:47,622 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:47,622 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:47,622 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:47,622 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 10:12:47,647 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:47,647 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:47,647 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:47,647 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:47,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 10:12:47,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 10:12:47,648 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:12:47,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 10:12:47,648 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:12:47,647 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 10:12:47,648 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:12:47,647 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:12:47,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 10:12:47,652 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-21 10:12:47,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-21 10:12:47,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-21 10:12:47,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportWithTargetName" 2023-07-21 10:12:47,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-21 10:12:47,724 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=756 (was 709) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (911300582) connection to jenkins-hbase17.apache.org/136.243.18.41:37771 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (911300582) connection to jenkins-hbase17.apache.org/136.243.18.41:33881 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:51368 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_317418272_1 at /127.0.0.1:34104 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (911300582) connection to jenkins-hbase17.apache.org/136.243.18.41:44969 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_317418272_1 at /127.0.0.1:45086 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:34132 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=785 (was 657) - SystemLoadAverage LEAK? -, ProcessCount=196 (was 187) - ProcessCount LEAK? -, AvailableMemoryMB=1570 (was 1508) - AvailableMemoryMB LEAK? - 2023-07-21 10:12:47,725 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-21 10:12:47,753 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=785, ProcessCount=196, AvailableMemoryMB=1569 2023-07-21 10:12:47,753 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-21 10:12:47,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:12:47,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:12:47,763 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:12:47,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-21 10:12:47,764 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:12:47,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:47,767 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b 2023-07-21 10:12:47,767 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6 2023-07-21 10:12:47,767 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b empty. 2023-07-21 10:12:47,768 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6 empty. 2023-07-21 10:12:47,770 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b 2023-07-21 10:12:47,771 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6 2023-07-21 10:12:47,772 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 10:12:47,801 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 10:12:47,803 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8586be7eefb724a0b3849383005f557b, NAME => 'testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:12:47,804 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0762e43964b4cae5545c30392cf889e6, NAME => 'testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:12:47,840 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:47,841 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8586be7eefb724a0b3849383005f557b, disabling compactions & flushes 2023-07-21 10:12:47,844 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:47,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:47,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. after waiting 0 ms 2023-07-21 10:12:47,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:47,844 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:47,844 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8586be7eefb724a0b3849383005f557b: 2023-07-21 10:12:47,846 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:47,847 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0762e43964b4cae5545c30392cf889e6, disabling compactions & flushes 2023-07-21 10:12:47,847 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:47,847 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:47,847 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. after waiting 0 ms 2023-07-21 10:12:47,847 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:47,848 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:47,848 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0762e43964b4cae5545c30392cf889e6: 2023-07-21 10:12:47,851 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:12:47,852 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934367851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934367851"}]},"ts":"1689934367851"} 2023-07-21 10:12:47,852 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934367851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934367851"}]},"ts":"1689934367851"} 2023-07-21 10:12:47,854 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:12:47,856 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:12:47,856 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934367856"}]},"ts":"1689934367856"} 2023-07-21 10:12:47,858 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 10:12:47,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:48,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:48,145 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:12:48,146 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:12:48,146 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:12:48,147 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:12:48,147 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:12:48,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8586be7eefb724a0b3849383005f557b, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0762e43964b4cae5545c30392cf889e6, ASSIGN}] 2023-07-21 10:12:48,150 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0762e43964b4cae5545c30392cf889e6, ASSIGN 2023-07-21 10:12:48,150 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8586be7eefb724a0b3849383005f557b, ASSIGN 2023-07-21 10:12:48,151 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0762e43964b4cae5545c30392cf889e6, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,42413,1689934328803; forceNewPlan=false, retain=false 2023-07-21 10:12:48,152 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8586be7eefb724a0b3849383005f557b, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38115,1689934328849; forceNewPlan=false, retain=false 2023-07-21 10:12:48,302 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:12:48,306 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0762e43964b4cae5545c30392cf889e6, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:48,306 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8586be7eefb724a0b3849383005f557b, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:48,307 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934368306"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934368306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934368306"}]},"ts":"1689934368306"} 2023-07-21 10:12:48,308 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934368306"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934368306"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934368306"}]},"ts":"1689934368306"} 2023-07-21 10:12:48,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 8586be7eefb724a0b3849383005f557b, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:12:48,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 0762e43964b4cae5545c30392cf889e6, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:12:48,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:48,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:48,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0762e43964b4cae5545c30392cf889e6, NAME => 'testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:12:48,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:48,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8586be7eefb724a0b3849383005f557b, NAME => 'testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:12:48,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. service=AccessControlService 2023-07-21 10:12:48,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:48,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0762e43964b4cae5545c30392cf889e6 2023-07-21 10:12:48,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:48,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0762e43964b4cae5545c30392cf889e6 2023-07-21 10:12:48,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0762e43964b4cae5545c30392cf889e6 2023-07-21 10:12:48,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. service=AccessControlService 2023-07-21 10:12:48,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:12:48,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8586be7eefb724a0b3849383005f557b 2023-07-21 10:12:48,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:12:48,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8586be7eefb724a0b3849383005f557b 2023-07-21 10:12:48,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8586be7eefb724a0b3849383005f557b 2023-07-21 10:12:48,472 INFO [StoreOpener-0762e43964b4cae5545c30392cf889e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0762e43964b4cae5545c30392cf889e6 2023-07-21 10:12:48,472 INFO [StoreOpener-8586be7eefb724a0b3849383005f557b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8586be7eefb724a0b3849383005f557b 2023-07-21 10:12:48,473 DEBUG [StoreOpener-0762e43964b4cae5545c30392cf889e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/cf 2023-07-21 10:12:48,473 DEBUG [StoreOpener-0762e43964b4cae5545c30392cf889e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/cf 2023-07-21 10:12:48,473 DEBUG [StoreOpener-8586be7eefb724a0b3849383005f557b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/cf 2023-07-21 10:12:48,473 DEBUG [StoreOpener-8586be7eefb724a0b3849383005f557b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/cf 2023-07-21 10:12:48,474 INFO [StoreOpener-8586be7eefb724a0b3849383005f557b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8586be7eefb724a0b3849383005f557b columnFamilyName cf 2023-07-21 10:12:48,474 INFO [StoreOpener-0762e43964b4cae5545c30392cf889e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0762e43964b4cae5545c30392cf889e6 columnFamilyName cf 2023-07-21 10:12:48,475 INFO [StoreOpener-8586be7eefb724a0b3849383005f557b-1] regionserver.HStore(310): Store=8586be7eefb724a0b3849383005f557b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:48,475 INFO [StoreOpener-0762e43964b4cae5545c30392cf889e6-1] regionserver.HStore(310): Store=0762e43964b4cae5545c30392cf889e6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:12:48,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6 2023-07-21 10:12:48,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b 2023-07-21 10:12:48,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6 2023-07-21 10:12:48,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b 2023-07-21 10:12:48,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0762e43964b4cae5545c30392cf889e6 2023-07-21 10:12:48,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8586be7eefb724a0b3849383005f557b 2023-07-21 10:12:48,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:48,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:12:48,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0762e43964b4cae5545c30392cf889e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67485230, jitterRate=0.005608290433883667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:48,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8586be7eefb724a0b3849383005f557b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62227857, jitterRate=-0.07273267209529877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:12:48,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0762e43964b4cae5545c30392cf889e6: 2023-07-21 10:12:48,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8586be7eefb724a0b3849383005f557b: 2023-07-21 10:12:48,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6., pid=31, masterSystemTime=1689934368466 2023-07-21 10:12:48,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b., pid=30, masterSystemTime=1689934368466 2023-07-21 10:12:48,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:48,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:48,488 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0762e43964b4cae5545c30392cf889e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:48,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:48,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:48,488 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934368488"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934368488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934368488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934368488"}]},"ts":"1689934368488"} 2023-07-21 10:12:48,489 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8586be7eefb724a0b3849383005f557b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:48,489 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934368489"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934368489"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934368489"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934368489"}]},"ts":"1689934368489"} 2023-07-21 10:12:48,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-21 10:12:48,497 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 0762e43964b4cae5545c30392cf889e6, server=jenkins-hbase17.apache.org,42413,1689934328803 in 180 msec 2023-07-21 10:12:48,498 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-21 10:12:48,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 8586be7eefb724a0b3849383005f557b, server=jenkins-hbase17.apache.org,38115,1689934328849 in 183 msec 2023-07-21 10:12:48,502 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0762e43964b4cae5545c30392cf889e6, ASSIGN in 350 msec 2023-07-21 10:12:48,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-21 10:12:48,504 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8586be7eefb724a0b3849383005f557b, ASSIGN in 354 msec 2023-07-21 10:12:48,504 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:12:48,505 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934368504"}]},"ts":"1689934368504"} 2023-07-21 10:12:48,506 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 10:12:48,852 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:12:48,852 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-21 10:12:48,856 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:12:48,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:49,304 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:49,305 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:49,305 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:49,305 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:12:49,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:49,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:49,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:49,592 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:12:49,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 1.8350 sec 2023-07-21 10:12:49,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 10:12:49,873 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-21 10:12:49,873 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-21 10:12:49,874 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:49,878 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-21 10:12:49,878 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:49,878 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-21 10:12:49,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:49,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934369898 (current time:1689934369898). 2023-07-21 10:12:49,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:12:49,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x122d11eb to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:49,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61422fee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:49,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:49,915 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:49,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x122d11eb to 127.0.0.1:60277 2023-07-21 10:12:49,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:49,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x0c5c9584 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:49,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76847fad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:50,024 DEBUG [hconnection-0x6c913cc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:50,027 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:50,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:50,042 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:50,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c5c9584 to 127.0.0.1:60277 2023-07-21 10:12:50,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:50,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:12:50,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:12:50,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:50,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:50,051 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:50,052 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689934970052 2023-07-21 10:12:50,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:50,052 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 10:12:50,054 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:12:50,054 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:12:50,057 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:50,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:50,060 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-21 10:12:50,062 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:50,063 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689934970063 2023-07-21 10:12:50,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,078 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-21 10:12:50,078 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:50,080 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 10:12:50,080 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 10:12:50,081 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,081 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,081 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,081 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,082 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,082 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,082 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,082 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,082 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,083 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:50,083 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:50,083 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,085 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:50,085 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:50,085 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:50,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,087 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:50,087 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:50,087 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:50,085 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:50,088 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:50,088 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:50,087 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:50,088 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:50,088 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:50,088 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:50,089 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,091 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,091 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,091 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,092 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,092 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:50,092 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,092 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:50,092 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,092 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,092 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:50,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 10:12:50,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3459d9bb[Count = 1] remaining members to acquire global barrier 2023-07-21 10:12:50,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 10:12:50,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3459d9bb[Count = 0] remaining members to acquire global barrier 2023-07-21 10:12:50,096 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 10:12:50,096 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:50,097 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,097 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:50,097 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:50,097 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:50,098 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:50,098 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. started... 2023-07-21 10:12:50,098 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,098 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:12:50,099 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:50,099 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:50,099 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:12:50,100 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:50,100 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:50,100 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:50,100 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:50,103 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:50,103 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8586be7eefb724a0b3849383005f557b: 2023-07-21 10:12:50,103 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. started... 2023-07-21 10:12:50,103 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:50,103 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,104 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0762e43964b4cae5545c30392cf889e6: 2023-07-21 10:12:50,104 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:50,104 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:12:50,104 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,104 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:50,105 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:12:50,135 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. completed. 2023-07-21 10:12:50,135 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:50,135 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:50,135 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:50,135 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,135 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:50,136 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:12:50,137 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:50,137 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,137 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:50,137 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:50,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,143 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. completed. 2023-07-21 10:12:50,143 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:50,143 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:50,143 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,143 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,144 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:50,144 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:12:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,145 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,145 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:50,145 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,145 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,42413,1689934328803': 2023-07-21 10:12:50,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 10:12:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:12:50,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 10:12:50,153 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-21 10:12:50,153 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:12:50,153 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:12:50,153 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,154 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:12:50,155 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:50,155 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,155 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,155 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,155 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,155 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,155 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,155 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:50,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,156 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:12:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,156 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,157 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,157 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,159 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,160 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,160 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,162 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,163 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,162 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,163 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,162 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,164 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,162 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,164 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,163 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,163 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:50,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,164 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 10:12:50,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,250 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 10:12:50,250 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689934370052Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689934370164 (+112 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689934370166 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689934370172 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689934370186 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689934370249 (+63 ms) 2023-07-21 10:12:50,253 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:50,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 199 msec 2023-07-21 10:12:50,356 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:50,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:50,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:12:50,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38115] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:12:50,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42413] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:12:50,386 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-21 10:12:50,387 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:50,387 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:12:50,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:50,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934370422 (current time:1689934370422). 2023-07-21 10:12:50,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:12:50,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x3c5eead5 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:50,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cc88d52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:50,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:50,452 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:50,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c5eead5 to 127.0.0.1:60277 2023-07-21 10:12:50,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:50,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x5a802e9f to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:12:50,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39c9c23f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:12:50,561 DEBUG [hconnection-0x7ad5d0e0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:50,563 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:57794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:50,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:12:50,572 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:50352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:12:50,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a802e9f to 127.0.0.1:60277 2023-07-21 10:12:50,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:12:50,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:12:50,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:12:50,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:50,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:50,580 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:50,582 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689934970582 2023-07-21 10:12:50,582 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 10:12:50,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:12:50,584 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:12:50,584 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:12:50,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:50,586 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:12:50,590 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-21 10:12:50,592 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:50,593 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689934970593 2023-07-21 10:12:50,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-21 10:12:50,632 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-21 10:12:50,632 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:50,640 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 10:12:50,641 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 10:12:50,681 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,682 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,683 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,683 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,683 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,683 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,683 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,683 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,684 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:50,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,684 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,684 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:12:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 10:12:50,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:50,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:50,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:50,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 10:12:50,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 10:12:50,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,686 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:50,686 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 10:12:50,686 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:12:50,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 10:12:50,691 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:50,692 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:50,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 10:12:50,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 10:12:50,693 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:50,694 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:50,694 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:50,694 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 10:12:50,696 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:50,696 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:50,694 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:50,696 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:50,696 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:12:50,696 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:50,697 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 10:12:50,697 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 10:12:50,697 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 10:12:50,703 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,703 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,704 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,704 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,704 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,704 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:50,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,703 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,704 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:50,704 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,705 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,705 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:12:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:50,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 10:12:50,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d622984[Count = 1] remaining members to acquire global barrier 2023-07-21 10:12:50,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 10:12:50,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d622984[Count = 0] remaining members to acquire global barrier 2023-07-21 10:12:50,710 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 10:12:50,710 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,715 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,715 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:50,716 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:50,716 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:50,716 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:50,716 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. started... 2023-07-21 10:12:50,716 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0762e43964b4cae5545c30392cf889e6 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-21 10:12:50,717 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,717 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,717 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:50,718 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,718 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:12:50,719 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,720 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:12:50,720 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:50,720 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:12:50,724 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:12:50,724 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:50,724 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:12:50,724 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. started... 2023-07-21 10:12:50,725 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8586be7eefb724a0b3849383005f557b 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-21 10:12:50,729 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:50,729 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:50,729 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:50,796 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/.tmp/cf/7e744e2ebf2440588e5d4cb902db559c 2023-07-21 10:12:50,812 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/.tmp/cf/c417cb1b07334a5ca0f41415cd36c21d 2023-07-21 10:12:50,814 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/.tmp/cf/7e744e2ebf2440588e5d4cb902db559c as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/cf/7e744e2ebf2440588e5d4cb902db559c 2023-07-21 10:12:50,823 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/.tmp/cf/c417cb1b07334a5ca0f41415cd36c21d as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/cf/c417cb1b07334a5ca0f41415cd36c21d 2023-07-21 10:12:50,825 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/cf/7e744e2ebf2440588e5d4cb902db559c, entries=44, sequenceid=6, filesize=7.8 K 2023-07-21 10:12:50,827 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 0762e43964b4cae5545c30392cf889e6 in 111ms, sequenceid=6, compaction requested=false 2023-07-21 10:12:50,827 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-21 10:12:50,828 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0762e43964b4cae5545c30392cf889e6: 2023-07-21 10:12:50,828 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 10:12:50,828 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:50,828 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/cf/7e744e2ebf2440588e5d4cb902db559c] hfiles 2023-07-21 10:12:50,828 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/cf/7e744e2ebf2440588e5d4cb902db559c for snapshot=snaptb0-testExportFileSystemState 2023-07-21 10:12:50,835 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/cf/c417cb1b07334a5ca0f41415cd36c21d, entries=6, sequenceid=6, filesize=5.2 K 2023-07-21 10:12:50,836 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 8586be7eefb724a0b3849383005f557b in 111ms, sequenceid=6, compaction requested=false 2023-07-21 10:12:50,842 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8586be7eefb724a0b3849383005f557b: 2023-07-21 10:12:50,843 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 10:12:50,843 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:12:50,843 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/cf/c417cb1b07334a5ca0f41415cd36c21d] hfiles 2023-07-21 10:12:50,843 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/cf/c417cb1b07334a5ca0f41415cd36c21d for snapshot=snaptb0-testExportFileSystemState 2023-07-21 10:12:50,854 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. completed. 2023-07-21 10:12:50,854 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:12:50,854 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:50,854 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:50,854 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,859 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:50,859 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:12:50,861 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:50,861 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,861 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:50,862 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:50,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:50,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,868 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. completed. 2023-07-21 10:12:50,868 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:12:50,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,42413,1689934328803': 2023-07-21 10:12:50,868 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:12:50,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 10:12:50,868 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:12:50,868 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,868 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 10:12:50,868 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:12:50,869 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 10:12:50,870 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:50,870 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 10:12:50,870 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 10:12:50,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:12:50,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 10:12:50,876 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-21 10:12:50,876 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:12:50,876 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:12:50,876 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-21 10:12:50,876 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:12:50,877 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,877 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,878 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,877 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,878 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,878 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,879 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,881 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,882 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,882 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,883 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,883 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,883 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:12:50,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:12:50,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:12:50,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,885 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,885 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,885 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:12:50,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:12:50,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-21 10:12:50,886 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:12:50,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:12:50,888 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:50,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-21 10:12:50,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:12:50,886 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,888 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:12:50,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:12:50,888 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:12:50,888 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,888 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:50,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:12:50,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,889 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:12:50,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:12:50,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:12:50,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-21 10:12:50,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 10:12:50,982 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0001_000001 (auth:SIMPLE) 2023-07-21 10:12:51,024 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 10:12:51,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:51,024 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:51,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689934370582Consolidate snapshot: snaptb0-testExportFileSystemState at 1689934370886 (+304 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689934370888 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689934370902 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689934370940 (+38 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689934371024 (+84 ms) 2023-07-21 10:12:51,027 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 10:12:51,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 444 msec 2023-07-21 10:12:51,189 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:12:51,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:12:51,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:12:51,191 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191 2023-07-21 10:12:51,191 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46589, tgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191, rawTgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191, srcFsUri=hdfs://localhost.localdomain:46589, srcDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:12:51,221 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:12:51,221 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1586946088_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:51,222 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a, snapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-21 10:12:51,253 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 10:12:51,330 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,330 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,331 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,331 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,332 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,339 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,339 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,461 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop-7136167265890929539.jar 2023-07-21 10:12:51,461 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,461 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,462 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,462 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,463 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,463 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:12:51,464 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:12:51,464 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:12:51,465 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:12:51,466 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:12:51,466 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:12:51,467 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:12:51,467 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:12:51,468 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:12:51,468 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:12:51,469 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:12:51,469 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:51,470 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:51,470 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:51,471 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:51,471 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:12:51,471 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:51,472 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:12:51,959 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:12:53,353 WARN [Listener at jenkins-hbase17.apache.org/33881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:12:53,357 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-21 10:12:53,360 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 10:12:53,582 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:12:53,582 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:12:53,707 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0002_000001 (auth:SIMPLE) 2023-07-21 10:13:00,037 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0002_000001 (auth:SIMPLE) 2023-07-21 10:13:02,338 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0002_000001 (auth:SIMPLE) 2023-07-21 10:13:07,004 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0002_000001 (auth:SIMPLE) 2023-07-21 10:13:08,823 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:13:08,824 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:13:08,834 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-21 10:13:08,834 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:13:08,835 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:13:08,835 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 10:13:08,836 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 10:13:08,836 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 10:13:08,836 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 10:13:08,836 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 10:13:08,837 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934371191/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 10:13:08,845 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-21 10:13:08,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemState 2023-07-21 10:13:08,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:08,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 10:13:08,852 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934388852"}]},"ts":"1689934388852"} 2023-07-21 10:13:08,854 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 10:13:08,855 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-21 10:13:08,857 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8586be7eefb724a0b3849383005f557b, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0762e43964b4cae5545c30392cf889e6, UNASSIGN}] 2023-07-21 10:13:08,859 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8586be7eefb724a0b3849383005f557b, UNASSIGN 2023-07-21 10:13:08,859 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0762e43964b4cae5545c30392cf889e6, UNASSIGN 2023-07-21 10:13:08,860 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0762e43964b4cae5545c30392cf889e6, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:08,860 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8586be7eefb724a0b3849383005f557b, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:08,861 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934388860"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934388860"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934388860"}]},"ts":"1689934388860"} 2023-07-21 10:13:08,861 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934388860"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934388860"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934388860"}]},"ts":"1689934388860"} 2023-07-21 10:13:08,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 0762e43964b4cae5545c30392cf889e6, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:13:08,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 8586be7eefb724a0b3849383005f557b, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:13:08,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 10:13:09,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 0762e43964b4cae5545c30392cf889e6 2023-07-21 10:13:09,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8586be7eefb724a0b3849383005f557b 2023-07-21 10:13:09,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0762e43964b4cae5545c30392cf889e6, disabling compactions & flushes 2023-07-21 10:13:09,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:13:09,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:13:09,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8586be7eefb724a0b3849383005f557b, disabling compactions & flushes 2023-07-21 10:13:09,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. after waiting 0 ms 2023-07-21 10:13:09,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:13:09,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:13:09,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. after waiting 0 ms 2023-07-21 10:13:09,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:13:09,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:13:09,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:13:09,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:13:09,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:13:09,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:13:09,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b. 2023-07-21 10:13:09,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8586be7eefb724a0b3849383005f557b: 2023-07-21 10:13:09,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6. 2023-07-21 10:13:09,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0762e43964b4cae5545c30392cf889e6: 2023-07-21 10:13:09,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8586be7eefb724a0b3849383005f557b 2023-07-21 10:13:09,037 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8586be7eefb724a0b3849383005f557b, regionState=CLOSED 2023-07-21 10:13:09,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 0762e43964b4cae5545c30392cf889e6 2023-07-21 10:13:09,037 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934389037"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934389037"}]},"ts":"1689934389037"} 2023-07-21 10:13:09,038 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0762e43964b4cae5545c30392cf889e6, regionState=CLOSED 2023-07-21 10:13:09,038 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689934389038"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934389038"}]},"ts":"1689934389038"} 2023-07-21 10:13:09,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-21 10:13:09,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 8586be7eefb724a0b3849383005f557b, server=jenkins-hbase17.apache.org,38115,1689934328849 in 175 msec 2023-07-21 10:13:09,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-21 10:13:09,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 0762e43964b4cae5545c30392cf889e6, server=jenkins-hbase17.apache.org,42413,1689934328803 in 177 msec 2023-07-21 10:13:09,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8586be7eefb724a0b3849383005f557b, UNASSIGN in 185 msec 2023-07-21 10:13:09,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-21 10:13:09,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0762e43964b4cae5545c30392cf889e6, UNASSIGN in 186 msec 2023-07-21 10:13:09,045 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934389044"}]},"ts":"1689934389044"} 2023-07-21 10:13:09,046 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 10:13:09,047 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-21 10:13:09,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 202 msec 2023-07-21 10:13:09,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 10:13:09,154 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-21 10:13:09,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemState 2023-07-21 10:13:09,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,158 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-21 10:13:09,159 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,163 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-21 10:13:09,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,166 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,167 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 10:13:09,167 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 10:13:09,167 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-21 10:13:09,168 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,168 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,168 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 10:13:09,168 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,168 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,168 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-21 10:13:09,168 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:13:09,168 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:13:09,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 10:13:09,169 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b 2023-07-21 10:13:09,169 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6 2023-07-21 10:13:09,172 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/recovered.edits] 2023-07-21 10:13:09,172 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/recovered.edits] 2023-07-21 10:13:09,186 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/cf/c417cb1b07334a5ca0f41415cd36c21d to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/cf/c417cb1b07334a5ca0f41415cd36c21d 2023-07-21 10:13:09,186 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/cf/7e744e2ebf2440588e5d4cb902db559c to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/cf/7e744e2ebf2440588e5d4cb902db559c 2023-07-21 10:13:09,189 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b/recovered.edits/9.seqid 2023-07-21 10:13:09,189 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6/recovered.edits/9.seqid 2023-07-21 10:13:09,192 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/0762e43964b4cae5545c30392cf889e6 2023-07-21 10:13:09,192 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemState/8586be7eefb724a0b3849383005f557b 2023-07-21 10:13:09,192 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 10:13:09,195 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,197 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-21 10:13:09,199 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-21 10:13:09,201 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,201 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-21 10:13:09,201 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934389201"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:09,201 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934389201"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:09,203 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:13:09,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8586be7eefb724a0b3849383005f557b, NAME => 'testtb-testExportFileSystemState,,1689934367755.8586be7eefb724a0b3849383005f557b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0762e43964b4cae5545c30392cf889e6, NAME => 'testtb-testExportFileSystemState,1,1689934367755.0762e43964b4cae5545c30392cf889e6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:13:09,203 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-21 10:13:09,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934389203"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:09,205 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-21 10:13:09,207 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 10:13:09,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 52 msec 2023-07-21 10:13:09,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 10:13:09,270 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-21 10:13:09,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-21 10:13:09,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-21 10:13:09,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemState" 2023-07-21 10:13:09,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-21 10:13:09,323 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=754 (was 756), OpenFileDescriptor=928 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=847 (was 785) - SystemLoadAverage LEAK? -, ProcessCount=193 (was 196), AvailableMemoryMB=1219 (was 1569) 2023-07-21 10:13:09,324 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-21 10:13:09,355 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=754, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=847, ProcessCount=193, AvailableMemoryMB=1212 2023-07-21 10:13:09,355 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-21 10:13:09,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:13:09,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:09,363 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:13:09,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-21 10:13:09,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 10:13:09,364 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:13:09,372 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:09,372 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:09,373 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06 empty. 2023-07-21 10:13:09,373 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0 empty. 2023-07-21 10:13:09,373 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:09,374 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:09,374 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 10:13:09,391 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-21 10:13:09,399 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => be5f20a9652e1f656a4363622b085e06, NAME => 'testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:13:09,400 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => c9ac6f8588d9290dc77924f91d69bae0, NAME => 'testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:13:09,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 10:13:09,472 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:09,472 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing c9ac6f8588d9290dc77924f91d69bae0, disabling compactions & flushes 2023-07-21 10:13:09,472 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:09,472 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:09,472 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. after waiting 0 ms 2023-07-21 10:13:09,472 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:09,472 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:09,472 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for c9ac6f8588d9290dc77924f91d69bae0: 2023-07-21 10:13:09,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:09,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing be5f20a9652e1f656a4363622b085e06, disabling compactions & flushes 2023-07-21 10:13:09,478 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:09,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:09,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. after waiting 0 ms 2023-07-21 10:13:09,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:09,478 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:09,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for be5f20a9652e1f656a4363622b085e06: 2023-07-21 10:13:09,482 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:13:09,483 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934389483"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934389483"}]},"ts":"1689934389483"} 2023-07-21 10:13:09,483 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934389483"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934389483"}]},"ts":"1689934389483"} 2023-07-21 10:13:09,486 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:13:09,487 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:13:09,487 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934389487"}]},"ts":"1689934389487"} 2023-07-21 10:13:09,489 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-21 10:13:09,491 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:13:09,493 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:13:09,493 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:13:09,493 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:13:09,493 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:13:09,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be5f20a9652e1f656a4363622b085e06, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c9ac6f8588d9290dc77924f91d69bae0, ASSIGN}] 2023-07-21 10:13:09,497 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be5f20a9652e1f656a4363622b085e06, ASSIGN 2023-07-21 10:13:09,497 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c9ac6f8588d9290dc77924f91d69bae0, ASSIGN 2023-07-21 10:13:09,498 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be5f20a9652e1f656a4363622b085e06, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38115,1689934328849; forceNewPlan=false, retain=false 2023-07-21 10:13:09,499 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c9ac6f8588d9290dc77924f91d69bae0, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35819,1689934328736; forceNewPlan=false, retain=false 2023-07-21 10:13:09,648 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:13:09,652 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=be5f20a9652e1f656a4363622b085e06, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:09,652 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c9ac6f8588d9290dc77924f91d69bae0, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:09,652 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934389652"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934389652"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934389652"}]},"ts":"1689934389652"} 2023-07-21 10:13:09,652 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934389652"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934389652"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934389652"}]},"ts":"1689934389652"} 2023-07-21 10:13:09,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure be5f20a9652e1f656a4363622b085e06, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:13:09,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure c9ac6f8588d9290dc77924f91d69bae0, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:13:09,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 10:13:09,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:09,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be5f20a9652e1f656a4363622b085e06, NAME => 'testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:13:09,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. service=AccessControlService 2023-07-21 10:13:09,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:13:09,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:09,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:09,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:09,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:09,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:09,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9ac6f8588d9290dc77924f91d69bae0, NAME => 'testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:13:09,825 INFO [StoreOpener-be5f20a9652e1f656a4363622b085e06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:09,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. service=AccessControlService 2023-07-21 10:13:09,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:13:09,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:09,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:09,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:09,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:09,829 DEBUG [StoreOpener-be5f20a9652e1f656a4363622b085e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/cf 2023-07-21 10:13:09,829 DEBUG [StoreOpener-be5f20a9652e1f656a4363622b085e06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/cf 2023-07-21 10:13:09,830 INFO [StoreOpener-be5f20a9652e1f656a4363622b085e06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be5f20a9652e1f656a4363622b085e06 columnFamilyName cf 2023-07-21 10:13:09,831 INFO [StoreOpener-be5f20a9652e1f656a4363622b085e06-1] regionserver.HStore(310): Store=be5f20a9652e1f656a4363622b085e06/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:13:09,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:09,832 INFO [StoreOpener-c9ac6f8588d9290dc77924f91d69bae0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:09,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:09,835 DEBUG [StoreOpener-c9ac6f8588d9290dc77924f91d69bae0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/cf 2023-07-21 10:13:09,835 DEBUG [StoreOpener-c9ac6f8588d9290dc77924f91d69bae0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/cf 2023-07-21 10:13:09,835 INFO [StoreOpener-c9ac6f8588d9290dc77924f91d69bae0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9ac6f8588d9290dc77924f91d69bae0 columnFamilyName cf 2023-07-21 10:13:09,836 INFO [StoreOpener-c9ac6f8588d9290dc77924f91d69bae0-1] regionserver.HStore(310): Store=c9ac6f8588d9290dc77924f91d69bae0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:13:09,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:09,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:09,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:09,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:09,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:13:09,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened be5f20a9652e1f656a4363622b085e06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68240648, jitterRate=0.016864895820617676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:13:09,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for be5f20a9652e1f656a4363622b085e06: 2023-07-21 10:13:09,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06., pid=45, masterSystemTime=1689934389811 2023-07-21 10:13:09,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:09,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:09,874 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=be5f20a9652e1f656a4363622b085e06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:09,874 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934389874"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934389874"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934389874"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934389874"}]},"ts":"1689934389874"} 2023-07-21 10:13:09,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:13:09,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened c9ac6f8588d9290dc77924f91d69bae0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71878236, jitterRate=0.07106918096542358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:13:09,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for c9ac6f8588d9290dc77924f91d69bae0: 2023-07-21 10:13:09,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0., pid=46, masterSystemTime=1689934389814 2023-07-21 10:13:09,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-21 10:13:09,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure be5f20a9652e1f656a4363622b085e06, server=jenkins-hbase17.apache.org,38115,1689934328849 in 223 msec 2023-07-21 10:13:09,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:09,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:09,883 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=c9ac6f8588d9290dc77924f91d69bae0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:09,883 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934389882"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934389882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934389882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934389882"}]},"ts":"1689934389882"} 2023-07-21 10:13:09,886 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be5f20a9652e1f656a4363622b085e06, ASSIGN in 388 msec 2023-07-21 10:13:09,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-21 10:13:09,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure c9ac6f8588d9290dc77924f91d69bae0, server=jenkins-hbase17.apache.org,35819,1689934328736 in 231 msec 2023-07-21 10:13:09,894 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:13:09,894 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934389894"}]},"ts":"1689934389894"} 2023-07-21 10:13:09,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-21 10:13:09,896 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c9ac6f8588d9290dc77924f91d69bae0, ASSIGN in 396 msec 2023-07-21 10:13:09,905 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-21 10:13:09,908 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:13:09,908 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-21 10:13:09,911 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 10:13:09,912 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,912 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,913 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,913 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:09,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:09,914 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:09,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:09,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:09,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 556 msec 2023-07-21 10:13:09,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 10:13:09,973 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-21 10:13:09,974 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-21 10:13:09,974 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:13:09,992 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-21 10:13:09,993 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:13:09,993 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-21 10:13:09,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:09,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934389998 (current time:1689934389998). 2023-07-21 10:13:09,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:13:09,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x16470ceb to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:10,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c53dca2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:10,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:10,028 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:10,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16470ceb to 127.0.0.1:60277 2023-07-21 10:13:10,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:10,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x76d667f4 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:10,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58d80d91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:10,040 DEBUG [hconnection-0x3a8c6ce4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:10,044 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:10,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:10,052 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:10,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76d667f4 to 127.0.0.1:60277 2023-07-21 10:13:10,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:10,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 10:13:10,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:13:10,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:10,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:10,062 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:10,063 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689934990063 2023-07-21 10:13:10,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 10:13:10,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:10,066 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:13:10,066 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:13:10,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:10,067 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:10,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-07-21 10:13:10,070 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:10,071 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689934990071 2023-07-21 10:13:10,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,090 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-21 10:13:10,090 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:10,092 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 10:13:10,092 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 10:13:10,092 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,092 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,093 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,093 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,093 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,093 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,094 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,094 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,094 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,095 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,095 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:13:10,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 10:13:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,095 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:10,095 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 10:13:10,095 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,095 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 10:13:10,097 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,097 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:10,097 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:10,097 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:10,097 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:10,098 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,098 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,098 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,098 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 10:13:10,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f36b677[Count = 1] remaining members to acquire global barrier 2023-07-21 10:13:10,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,100 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:10,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,100 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:10,100 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:10,102 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:10,102 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:10,106 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:10,106 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:10,106 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:10,106 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:10,106 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:10,108 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,108 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,108 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,108 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,108 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,108 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,108 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 10:13:10,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f36b677[Count = 0] remaining members to acquire global barrier 2023-07-21 10:13:10,110 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 10:13:10,110 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,113 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,113 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,113 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,114 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,114 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,114 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,114 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:10,114 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,114 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:10,114 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:10,114 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:13:10,114 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:10,114 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:10,114 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:13:10,114 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. started... 2023-07-21 10:13:10,115 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:10,115 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:10,115 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:10,116 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:10,118 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:10,118 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:10,118 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be5f20a9652e1f656a4363622b085e06: 2023-07-21 10:13:10,118 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. started... 2023-07-21 10:13:10,118 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,119 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c9ac6f8588d9290dc77924f91d69bae0: 2023-07-21 10:13:10,119 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:10,119 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:13:10,120 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,120 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:10,120 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:13:10,140 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. completed. 2023-07-21 10:13:10,140 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:10,141 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:10,141 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:10,141 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,141 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:10,141 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:13:10,142 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,142 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:10,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,142 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:10,142 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:10,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:13:10,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 10:13:10,164 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. completed. 2023-07-21 10:13:10,164 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:10,164 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:10,164 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:10,164 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,164 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:10,164 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:13:10,165 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,166 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,166 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:10,166 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:10,167 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 10:13:10,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:13:10,169 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:13:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,35819,1689934328736': 2023-07-21 10:13:10,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 10:13:10,172 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-21 10:13:10,172 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:13:10,172 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:13:10,172 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,172 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:13:10,173 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,173 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,173 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,173 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,173 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,173 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,173 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,174 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,175 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,176 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,178 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,178 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,179 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,182 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,182 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,182 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,182 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,182 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,183 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,183 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,183 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,183 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,183 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,183 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,183 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:10,183 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,183 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,186 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,186 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,186 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,186 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,186 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 10:13:10,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,242 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:10,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689934390063Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689934390185 (+122 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689934390185Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689934390195 (+10 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689934390209 (+14 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689934390241 (+32 ms) 2023-07-21 10:13:10,245 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:10,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 180 msec 2023-07-21 10:13:10,369 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:10,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 10:13:10,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:13:10,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38115] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:13:10,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35819] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:13:10,384 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-21 10:13:10,384 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:10,384 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:13:10,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:10,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934390400 (current time:1689934390400). 2023-07-21 10:13:10,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:13:10,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x26afae18 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:10,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ea17d59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:10,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:10,415 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:10,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26afae18 to 127.0.0.1:60277 2023-07-21 10:13:10,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:10,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x72a1b2b1 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:10,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29a51d93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:10,436 DEBUG [hconnection-0x1cdbe64b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:10,441 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:58116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:10,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:10,449 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:36850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:10,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72a1b2b1 to 127.0.0.1:60277 2023-07-21 10:13:10,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:10,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 10:13:10,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:13:10,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:10,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:10,457 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:10,458 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689934990458 2023-07-21 10:13:10,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 10:13:10,459 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 10:13:10,459 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:13:10,459 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:13:10,465 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 10:13:10,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:10,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-07-21 10:13:10,468 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:10,469 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689934990469 2023-07-21 10:13:10,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-21 10:13:10,480 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-21 10:13:10,480 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:10,482 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 10:13:10,482 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 10:13:10,483 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,483 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,484 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,484 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,484 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,484 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,484 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,484 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,485 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,485 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:13:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 10:13:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,485 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:10,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 10:13:10,486 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:10,486 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:10,487 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:10,487 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:10,487 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 10:13:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,488 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 10:13:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,488 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 10:13:10,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 10:13:10,489 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:10,489 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:10,489 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,490 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,490 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:10,496 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 10:13:10,497 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:10,498 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 10:13:10,498 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:10,498 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:10,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,499 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:10,499 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 10:13:10,499 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 10:13:10,499 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 10:13:10,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,500 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,501 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,503 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,503 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:10,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:10,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,504 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,504 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,504 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:10,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 10:13:10,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19c3faf0[Count = 1] remaining members to acquire global barrier 2023-07-21 10:13:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:10,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 10:13:10,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19c3faf0[Count = 0] remaining members to acquire global barrier 2023-07-21 10:13:10,513 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 10:13:10,513 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,514 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,514 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,514 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,514 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:10,515 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:10,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,515 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:13:10,515 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:10,515 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,515 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 10:13:10,515 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:10,515 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:10,515 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:10,515 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. started... 2023-07-21 10:13:10,516 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c9ac6f8588d9290dc77924f91d69bae0 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-21 10:13:10,516 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:10,516 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:10,516 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:10,516 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. started... 2023-07-21 10:13:10,516 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing be5f20a9652e1f656a4363622b085e06 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-21 10:13:10,523 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:10,524 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,524 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:13:10,524 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:10,524 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:10,548 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/.tmp/cf/041eaca4b7f840f2a8261ad34ff5cb18 2023-07-21 10:13:10,549 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/.tmp/cf/b2ba88fbe3b346cea61eca5b3bf81635 2023-07-21 10:13:10,556 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/.tmp/cf/b2ba88fbe3b346cea61eca5b3bf81635 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/cf/b2ba88fbe3b346cea61eca5b3bf81635 2023-07-21 10:13:10,556 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/.tmp/cf/041eaca4b7f840f2a8261ad34ff5cb18 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/cf/041eaca4b7f840f2a8261ad34ff5cb18 2023-07-21 10:13:10,559 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:10,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 10:13:10,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:13:10,562 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:13:10,563 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/cf/041eaca4b7f840f2a8261ad34ff5cb18, entries=46, sequenceid=6, filesize=7.9 K 2023-07-21 10:13:10,564 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for c9ac6f8588d9290dc77924f91d69bae0 in 48ms, sequenceid=6, compaction requested=false 2023-07-21 10:13:10,564 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-21 10:13:10,565 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c9ac6f8588d9290dc77924f91d69bae0: 2023-07-21 10:13:10,565 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 10:13:10,565 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:10,565 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/cf/041eaca4b7f840f2a8261ad34ff5cb18] hfiles 2023-07-21 10:13:10,565 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/cf/041eaca4b7f840f2a8261ad34ff5cb18 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 10:13:10,566 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/cf/b2ba88fbe3b346cea61eca5b3bf81635, entries=4, sequenceid=6, filesize=5.1 K 2023-07-21 10:13:10,567 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for be5f20a9652e1f656a4363622b085e06 in 51ms, sequenceid=6, compaction requested=false 2023-07-21 10:13:10,569 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for be5f20a9652e1f656a4363622b085e06: 2023-07-21 10:13:10,570 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 10:13:10,570 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:10,570 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/cf/b2ba88fbe3b346cea61eca5b3bf81635] hfiles 2023-07-21 10:13:10,570 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/cf/b2ba88fbe3b346cea61eca5b3bf81635 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 10:13:10,597 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. completed. 2023-07-21 10:13:10,597 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:10,597 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:10,597 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:10,597 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,597 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:10,597 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:13:10,598 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:10,598 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,598 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:10,599 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:10,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:10,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,604 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. completed. 2023-07-21 10:13:10,604 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:10,604 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:10,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,604 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:10,604 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,605 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 10:13:10,605 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:13:10,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,606 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:10,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,35819,1689934328736': 2023-07-21 10:13:10,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 10:13:10,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,608 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 10:13:10,608 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:10,608 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 10:13:10,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:10,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:10,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:13:10,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 10:13:10,612 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-21 10:13:10,614 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:13:10,614 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:13:10,614 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-21 10:13:10,614 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:13:10,616 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,616 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,616 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,616 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,616 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,616 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:10,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:10,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,616 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,616 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:10,617 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:10,618 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:10,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:10,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,619 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,620 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:10,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,620 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 10:13:10,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:10,625 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:10,625 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,626 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:10,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:10,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-21 10:13:10,625 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:10,626 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,626 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:10,626 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:10,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,626 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,626 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:10,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:10,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 10:13:10,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,685 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689934390459Consolidate snapshot: snaptb0-testConsecutiveExports at 1689934390626 (+167 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689934390626Writing data manifest for snaptb0-testConsecutiveExports at 1689934390637 (+11 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689934390654 (+17 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689934390684 (+30 ms) 2023-07-21 10:13:10,688 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 10:13:10,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 227 msec 2023-07-21 10:13:10,762 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:10,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 10:13:10,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:13:10,764 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764 2023-07-21 10:13:10,764 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764, srcFsUri=hdfs://localhost.localdomain:46589, srcDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:13:10,784 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:13:10,784 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7e5bfb15, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,784 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a, snapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 10:13:10,792 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:10,803 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,803 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,804 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,804 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,804 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,805 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,805 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,888 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop-2443113413466661482.jar 2023-07-21 10:13:10,888 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,889 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,889 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,890 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,890 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,891 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:10,891 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:13:10,892 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:13:10,893 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:13:10,893 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:13:10,893 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:13:10,894 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:13:10,894 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:13:10,895 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:13:10,895 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:13:10,895 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:13:10,896 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:10,897 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:10,897 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:10,898 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:10,898 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:10,898 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:10,899 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:12,754 WARN [Listener at jenkins-hbase17.apache.org/33881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:13:12,757 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 10:13:12,760 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 10:13:13,214 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:13:13,214 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:13:13,220 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0002_000001 (auth:SIMPLE) 2023-07-21 10:13:13,995 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:14,658 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:13:19,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:22,141 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:25,515 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:27,188 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:13:27,188 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:13:27,192 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 10:13:27,193 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:13:27,193 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:13:27,194 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:27,197 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 10:13:27,197 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 10:13:27,197 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@f87a85d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:27,197 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 10:13:27,198 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 10:13:27,199 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764, srcFsUri=hdfs://localhost.localdomain:46589, srcDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:13:27,221 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:13:27,221 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@75e612b6, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:27,221 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a, snapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 10:13:27,233 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 10:13:27,244 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,245 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,245 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,246 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,246 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,247 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,247 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,312 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop-5656968196650707164.jar 2023-07-21 10:13:27,312 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,313 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,313 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,313 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,313 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,314 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:13:27,314 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:13:27,314 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:13:27,315 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:13:27,315 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:13:27,315 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:13:27,316 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:13:27,316 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:13:27,316 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:13:27,317 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:13:27,317 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:13:27,318 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:27,318 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:27,319 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:27,319 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:27,319 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:13:27,320 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:27,320 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:13:27,863 WARN [Listener at jenkins-hbase17.apache.org/33881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:13:27,869 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 10:13:27,873 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 10:13:31,718 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:13:31,718 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:13:31,733 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0003_000001 (auth:SIMPLE) 2023-07-21 10:13:32,244 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0004_000001 (auth:SIMPLE) 2023-07-21 10:13:44,036 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0004_000001 (auth:SIMPLE) 2023-07-21 10:13:46,572 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0004_000001 (auth:SIMPLE) 2023-07-21 10:13:52,806 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0004_000001 (auth:SIMPLE) 2023-07-21 10:13:54,731 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:13:54,731 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:13:54,744 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 10:13:54,745 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:13:54,745 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:13:54,745 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:54,754 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 10:13:54,755 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 10:13:54,755 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@f87a85d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 10:13:54,755 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 10:13:54,755 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/local-export-1689934390764/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 10:13:54,788 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-21 10:13:54,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testConsecutiveExports 2023-07-21 10:13:54,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:54,803 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934434803"}]},"ts":"1689934434803"} 2023-07-21 10:13:54,820 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-21 10:13:54,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 10:13:54,828 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-21 10:13:54,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be5f20a9652e1f656a4363622b085e06, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c9ac6f8588d9290dc77924f91d69bae0, UNASSIGN}] 2023-07-21 10:13:54,836 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c9ac6f8588d9290dc77924f91d69bae0, UNASSIGN 2023-07-21 10:13:54,839 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be5f20a9652e1f656a4363622b085e06, UNASSIGN 2023-07-21 10:13:54,856 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c9ac6f8588d9290dc77924f91d69bae0, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:54,857 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934434856"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934434856"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934434856"}]},"ts":"1689934434856"} 2023-07-21 10:13:54,858 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=be5f20a9652e1f656a4363622b085e06, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:54,858 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934434858"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934434858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934434858"}]},"ts":"1689934434858"} 2023-07-21 10:13:54,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure c9ac6f8588d9290dc77924f91d69bae0, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:13:54,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure be5f20a9652e1f656a4363622b085e06, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:13:54,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 10:13:55,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:55,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing be5f20a9652e1f656a4363622b085e06, disabling compactions & flushes 2023-07-21 10:13:55,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:55,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:55,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. after waiting 0 ms 2023-07-21 10:13:55,033 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:55,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:55,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing c9ac6f8588d9290dc77924f91d69bae0, disabling compactions & flushes 2023-07-21 10:13:55,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:55,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:55,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. after waiting 0 ms 2023-07-21 10:13:55,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:55,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 10:13:55,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:13:55,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:13:55,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:13:55,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0. 2023-07-21 10:13:55,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for c9ac6f8588d9290dc77924f91d69bae0: 2023-07-21 10:13:55,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:13:55,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06. 2023-07-21 10:13:55,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for be5f20a9652e1f656a4363622b085e06: 2023-07-21 10:13:55,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:55,203 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=c9ac6f8588d9290dc77924f91d69bae0, regionState=CLOSED 2023-07-21 10:13:55,203 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934435202"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934435202"}]},"ts":"1689934435202"} 2023-07-21 10:13:55,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:55,212 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=be5f20a9652e1f656a4363622b085e06, regionState=CLOSED 2023-07-21 10:13:55,212 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689934435212"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934435212"}]},"ts":"1689934435212"} 2023-07-21 10:13:55,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-21 10:13:55,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure be5f20a9652e1f656a4363622b085e06, server=jenkins-hbase17.apache.org,38115,1689934328849 in 376 msec 2023-07-21 10:13:55,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-21 10:13:55,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure c9ac6f8588d9290dc77924f91d69bae0, server=jenkins-hbase17.apache.org,35819,1689934328736 in 380 msec 2023-07-21 10:13:55,274 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=c9ac6f8588d9290dc77924f91d69bae0, UNASSIGN in 434 msec 2023-07-21 10:13:55,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-21 10:13:55,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=be5f20a9652e1f656a4363622b085e06, UNASSIGN in 434 msec 2023-07-21 10:13:55,293 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934435293"}]},"ts":"1689934435293"} 2023-07-21 10:13:55,306 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-21 10:13:55,316 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-21 10:13:55,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 528 msec 2023-07-21 10:13:55,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 10:13:55,481 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-21 10:13:55,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testConsecutiveExports 2023-07-21 10:13:55,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:55,493 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:55,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-21 10:13:55,499 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-21 10:13:55,506 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:55,506 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:55,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 10:13:55,508 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 10:13:55,508 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:55,509 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:55,511 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:55,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 10:13:55,532 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:55,532 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:55,532 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:55,532 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:55,532 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:55,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-21 10:13:55,533 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:13:55,533 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 10:13:55,533 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:55,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 10:13:55,559 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:55,561 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:55,565 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/recovered.edits] 2023-07-21 10:13:55,578 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/cf/b2ba88fbe3b346cea61eca5b3bf81635 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/cf/b2ba88fbe3b346cea61eca5b3bf81635 2023-07-21 10:13:55,584 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06/recovered.edits/9.seqid 2023-07-21 10:13:55,593 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/recovered.edits] 2023-07-21 10:13:55,594 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/be5f20a9652e1f656a4363622b085e06 2023-07-21 10:13:55,623 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/cf/041eaca4b7f840f2a8261ad34ff5cb18 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/cf/041eaca4b7f840f2a8261ad34ff5cb18 2023-07-21 10:13:55,632 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0/recovered.edits/9.seqid 2023-07-21 10:13:55,633 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testConsecutiveExports/c9ac6f8588d9290dc77924f91d69bae0 2023-07-21 10:13:55,636 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 10:13:55,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 10:13:55,644 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:55,655 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-21 10:13:55,662 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-21 10:13:55,664 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:55,664 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-21 10:13:55,664 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934435664"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:55,665 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934435664"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:55,675 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:13:55,675 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => be5f20a9652e1f656a4363622b085e06, NAME => 'testtb-testConsecutiveExports,,1689934389357.be5f20a9652e1f656a4363622b085e06.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c9ac6f8588d9290dc77924f91d69bae0, NAME => 'testtb-testConsecutiveExports,1,1689934389357.c9ac6f8588d9290dc77924f91d69bae0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:13:55,675 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-21 10:13:55,675 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934435675"}]},"ts":"9223372036854775807"} 2023-07-21 10:13:55,683 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-21 10:13:55,701 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 10:13:55,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 219 msec 2023-07-21 10:13:55,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 10:13:55,844 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-21 10:13:55,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-21 10:13:55,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-21 10:13:55,913 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testConsecutiveExports" 2023-07-21 10:13:55,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-21 10:13:56,028 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=746 (was 754), OpenFileDescriptor=898 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1259 (was 847) - SystemLoadAverage LEAK? -, ProcessCount=195 (was 193) - ProcessCount LEAK? -, AvailableMemoryMB=604 (was 1212) 2023-07-21 10:13:56,029 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-21 10:13:56,102 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=1259, ProcessCount=195, AvailableMemoryMB=602 2023-07-21 10:13:56,102 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-21 10:13:56,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:13:56,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:56,113 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:13:56,115 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:13:56,116 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-21 10:13:56,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:13:56,133 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:13:56,135 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:13:56,136 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2 empty. 2023-07-21 10:13:56,137 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5 empty. 2023-07-21 10:13:56,137 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:13:56,165 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:13:56,168 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 10:13:56,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:13:56,256 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-21 10:13:56,277 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => ca6d0169a71524be3b62c30348be6ab2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:13:56,277 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0c45cff7a92f89898d3acef62ed4a1a5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:13:56,366 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:56,366 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing ca6d0169a71524be3b62c30348be6ab2, disabling compactions & flushes 2023-07-21 10:13:56,366 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:56,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:56,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. after waiting 0 ms 2023-07-21 10:13:56,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:56,367 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:56,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for ca6d0169a71524be3b62c30348be6ab2: 2023-07-21 10:13:56,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:56,372 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0c45cff7a92f89898d3acef62ed4a1a5, disabling compactions & flushes 2023-07-21 10:13:56,373 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:13:56,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:13:56,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. after waiting 0 ms 2023-07-21 10:13:56,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:13:56,373 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:13:56,373 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0c45cff7a92f89898d3acef62ed4a1a5: 2023-07-21 10:13:56,384 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:13:56,385 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934436385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934436385"}]},"ts":"1689934436385"} 2023-07-21 10:13:56,386 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934436385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934436385"}]},"ts":"1689934436385"} 2023-07-21 10:13:56,398 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:13:56,400 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:13:56,400 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934436400"}]},"ts":"1689934436400"} 2023-07-21 10:13:56,404 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-21 10:13:56,413 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:13:56,415 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:13:56,415 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:13:56,415 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:13:56,415 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:13:56,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca6d0169a71524be3b62c30348be6ab2, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c45cff7a92f89898d3acef62ed4a1a5, ASSIGN}] 2023-07-21 10:13:56,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:13:56,424 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca6d0169a71524be3b62c30348be6ab2, ASSIGN 2023-07-21 10:13:56,425 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c45cff7a92f89898d3acef62ed4a1a5, ASSIGN 2023-07-21 10:13:56,430 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca6d0169a71524be3b62c30348be6ab2, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38115,1689934328849; forceNewPlan=false, retain=false 2023-07-21 10:13:56,431 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c45cff7a92f89898d3acef62ed4a1a5, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,42413,1689934328803; forceNewPlan=false, retain=false 2023-07-21 10:13:56,580 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:13:56,584 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0c45cff7a92f89898d3acef62ed4a1a5, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:56,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934436584"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934436584"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934436584"}]},"ts":"1689934436584"} 2023-07-21 10:13:56,584 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ca6d0169a71524be3b62c30348be6ab2, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:56,585 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934436584"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934436584"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934436584"}]},"ts":"1689934436584"} 2023-07-21 10:13:56,594 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 0c45cff7a92f89898d3acef62ed4a1a5, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:13:56,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure ca6d0169a71524be3b62c30348be6ab2, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:13:56,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:13:56,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:56,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ca6d0169a71524be3b62c30348be6ab2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:13:56,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. service=AccessControlService 2023-07-21 10:13:56,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:13:56,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:13:56,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:56,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:13:56,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:13:56,781 INFO [StoreOpener-ca6d0169a71524be3b62c30348be6ab2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:13:56,789 DEBUG [StoreOpener-ca6d0169a71524be3b62c30348be6ab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/cf 2023-07-21 10:13:56,789 DEBUG [StoreOpener-ca6d0169a71524be3b62c30348be6ab2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/cf 2023-07-21 10:13:56,791 INFO [StoreOpener-ca6d0169a71524be3b62c30348be6ab2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ca6d0169a71524be3b62c30348be6ab2 columnFamilyName cf 2023-07-21 10:13:56,792 INFO [StoreOpener-ca6d0169a71524be3b62c30348be6ab2-1] regionserver.HStore(310): Store=ca6d0169a71524be3b62c30348be6ab2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:13:56,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:13:56,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:13:56,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:13:56,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:13:56,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened ca6d0169a71524be3b62c30348be6ab2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70657791, jitterRate=0.05288313329219818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:13:56,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for ca6d0169a71524be3b62c30348be6ab2: 2023-07-21 10:13:56,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2., pid=61, masterSystemTime=1689934436760 2023-07-21 10:13:56,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:13:56,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0c45cff7a92f89898d3acef62ed4a1a5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:13:56,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. service=AccessControlService 2023-07-21 10:13:56,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:13:56,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:13:56,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:13:56,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:13:56,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:13:56,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:56,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:56,864 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ca6d0169a71524be3b62c30348be6ab2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:56,865 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934436864"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934436864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934436864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934436864"}]},"ts":"1689934436864"} 2023-07-21 10:13:56,868 INFO [StoreOpener-0c45cff7a92f89898d3acef62ed4a1a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:13:56,877 DEBUG [StoreOpener-0c45cff7a92f89898d3acef62ed4a1a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/cf 2023-07-21 10:13:56,877 DEBUG [StoreOpener-0c45cff7a92f89898d3acef62ed4a1a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/cf 2023-07-21 10:13:56,878 INFO [StoreOpener-0c45cff7a92f89898d3acef62ed4a1a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0c45cff7a92f89898d3acef62ed4a1a5 columnFamilyName cf 2023-07-21 10:13:56,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-21 10:13:56,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure ca6d0169a71524be3b62c30348be6ab2, server=jenkins-hbase17.apache.org,38115,1689934328849 in 276 msec 2023-07-21 10:13:56,882 INFO [StoreOpener-0c45cff7a92f89898d3acef62ed4a1a5-1] regionserver.HStore(310): Store=0c45cff7a92f89898d3acef62ed4a1a5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:13:56,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:13:56,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:13:56,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca6d0169a71524be3b62c30348be6ab2, ASSIGN in 463 msec 2023-07-21 10:13:56,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:13:56,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:13:56,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 0c45cff7a92f89898d3acef62ed4a1a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72566063, jitterRate=0.08131860196590424}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:13:56,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 0c45cff7a92f89898d3acef62ed4a1a5: 2023-07-21 10:13:56,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5., pid=60, masterSystemTime=1689934436760 2023-07-21 10:13:56,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:13:56,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:13:56,927 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0c45cff7a92f89898d3acef62ed4a1a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:56,927 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934436927"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934436927"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934436927"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934436927"}]},"ts":"1689934436927"} 2023-07-21 10:13:56,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-21 10:13:56,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 0c45cff7a92f89898d3acef62ed4a1a5, server=jenkins-hbase17.apache.org,42413,1689934328803 in 352 msec 2023-07-21 10:13:56,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-21 10:13:56,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c45cff7a92f89898d3acef62ed4a1a5, ASSIGN in 540 msec 2023-07-21 10:13:56,974 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:13:56,974 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934436974"}]},"ts":"1689934436974"} 2023-07-21 10:13:56,979 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-21 10:13:56,985 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:13:56,986 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-21 10:13:56,997 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 10:13:57,000 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:57,000 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:57,000 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:57,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:57,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:57,000 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:13:57,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 897 msec 2023-07-21 10:13:57,008 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:57,015 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:13:57,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 10:13:57,228 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-21 10:13:57,229 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-21 10:13:57,229 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:13:57,249 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-21 10:13:57,249 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:13:57,250 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-21 10:13:57,267 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:13:57,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934437267 (current time:1689934437267). 2023-07-21 10:13:57,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:13:57,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x18cf7fc6 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:57,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22db8cbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:57,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:57,314 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:57,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18cf7fc6 to 127.0.0.1:60277 2023-07-21 10:13:57,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:57,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x16065d36 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:57,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75d4317f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:57,384 DEBUG [hconnection-0xb94e51c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:57,386 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:57,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:57,396 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:39662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:57,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16065d36 to 127.0.0.1:60277 2023-07-21 10:13:57,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:57,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 10:13:57,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:13:57,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:13:57,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:13:57,433 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:13:57,440 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689935037440 2023-07-21 10:13:57,441 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:13:57,443 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:13:57,443 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:13:57,450 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:13:57,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:13:57,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 39 msec 2023-07-21 10:13:57,458 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:13:57,459 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689935037459 2023-07-21 10:13:57,544 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:57,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:13:57,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:13:57,549 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:13:57,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,576 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 10:13:57,576 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:57,576 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 10:13:57,576 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 10:13:57,577 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,577 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,578 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:57,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:57,578 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:57,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:57,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 10:13:57,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,579 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:13:57,580 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 10:13:57,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,580 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:57,580 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:13:57,580 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,580 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,581 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,581 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:13:57,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:57,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:57,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 10:13:57,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:13:57,587 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,587 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:13:57,587 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:57,592 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:13:57,593 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:13:57,593 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:13:57,595 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,595 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:13:57,595 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:57,614 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:13:57,614 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:13:57,614 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:13:57,616 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,616 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,616 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:57,619 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:57,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:57,624 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,626 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,626 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:57,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:57,628 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:13:57,631 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:57,634 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:13:57,634 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:13:57,634 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:13:57,639 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,640 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,641 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,641 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:13:57,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:57,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 10:13:57,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@632d6c72[Count = 1] remaining members to acquire global barrier 2023-07-21 10:13:57,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:57,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:57,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:57,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:57,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:57,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 10:13:57,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@632d6c72[Count = 0] remaining members to acquire global barrier 2023-07-21 10:13:57,651 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 10:13:57,651 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,653 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,653 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,653 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:13:57,654 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,654 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,654 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:13:57,655 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:57,656 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:57,656 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:13:57,656 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,656 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. started... 2023-07-21 10:13:57,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,657 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:13:57,657 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:13:57,657 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:13:57,660 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c45cff7a92f89898d3acef62ed4a1a5: 2023-07-21 10:13:57,661 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,661 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:57,661 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:13:57,661 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:13:57,663 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:13:57,663 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:57,663 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:13:57,664 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:13:57,664 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:13:57,664 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:57,664 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. started... 2023-07-21 10:13:57,667 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca6d0169a71524be3b62c30348be6ab2: 2023-07-21 10:13:57,667 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,667 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:13:57,667 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:13:57,752 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:57,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:13:57,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:13:57,753 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:13:57,789 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. completed. 2023-07-21 10:13:57,789 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:13:57,790 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:57,790 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:57,790 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,790 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:13:57,790 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:13:57,791 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,792 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:13:57,792 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:57,792 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:13:57,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:57,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:57,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:57,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:57,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:57,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,42413,1689934328803': 2023-07-21 10:13:57,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 10:13:57,838 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. completed. 2023-07-21 10:13:57,838 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:57,844 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:13:57,844 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:13:57,844 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,844 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:13:57,844 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:13:57,850 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:57,852 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:13:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:13:57,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 10:13:57,852 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:57,856 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 10:13:57,856 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:13:57,856 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:13:57,856 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:13:57,857 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,857 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:13:57,859 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,859 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,859 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:57,859 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:57,859 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,859 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:57,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,872 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:13:57,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:13:57,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:13:57,874 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,875 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:13:57,875 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:13:57,878 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,879 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,879 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,882 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:57,882 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:57,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:57,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:57,883 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:57,883 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:57,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:57,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:57,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:57,884 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:13:57,884 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:13:57,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:13:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:13:57,884 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,884 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:13:57,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:13:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:13:57,884 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,885 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,885 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,885 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,885 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:13:57,885 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,889 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:13:57,889 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:13:57,889 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,889 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,888 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:57,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:58,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:58,054 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:58,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:13:58,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:13:58,055 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:13:58,188 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 10:13:58,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:58,189 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:58,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689934437441Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689934437892 (+451 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689934437892Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689934437920 (+28 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689934438004 (+84 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689934438188 (+184 ms) 2023-07-21 10:13:58,192 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:13:58,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 745 msec 2023-07-21 10:13:58,556 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:58,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:13:58,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:13:58,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38115] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:13:58,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42413] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:13:58,606 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:58,606 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:13:58,606 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:13:58,680 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:13:58,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934438680 (current time:1689934438680). 2023-07-21 10:13:58,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:13:58,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x0a58d058 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:59,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b2abf62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:59,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:59,339 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:59,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a58d058 to 127.0.0.1:60277 2023-07-21 10:13:59,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:59,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x136e1654 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:13:59,416 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-21 10:13:59,449 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0004_000001 (auth:SIMPLE) 2023-07-21 10:13:59,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f78ce71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:13:59,769 DEBUG [hconnection-0x11e7bb53-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:59,774 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:59,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:13:59,782 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:13:59,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x136e1654 to 127.0.0.1:60277 2023-07-21 10:13:59,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:13:59,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 10:13:59,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:13:59,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:13:59,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:13:59,788 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:13:59,789 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689935039789 2023-07-21 10:13:59,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 10:13:59,789 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:59,791 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:13:59,791 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:13:59,793 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 10:13:59,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:13:59,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-21 10:13:59,795 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:13:59,796 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689935039796 2023-07-21 10:13:59,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:13:59,820 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 10:13:59,821 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:13:59,822 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 10:13:59,822 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 10:13:59,891 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:13:59,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:13:59,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:13:59,893 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:00,093 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:00,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:00,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:00,094 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:00,186 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,186 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,400 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:00,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:00,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:00,402 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:14:00,581 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:00,581 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:00,584 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:00,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:00,588 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:00,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,592 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,592 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,596 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,596 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 10:14:00,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:14:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 10:14:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:14:00,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,603 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,603 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:14:00,603 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:00,606 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:14:00,606 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:14:00,606 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:14:00,610 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:14:00,610 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:00,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 10:14:00,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,626 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 10:14:00,626 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:14:00,626 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:14:00,626 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:14:00,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,628 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 10:14:00,628 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:00,634 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 10:14:00,634 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 10:14:00,634 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 10:14:00,652 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,652 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:00,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:00,653 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,661 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:00,661 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:00,661 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,661 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,661 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,661 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:00,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:00,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:00,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:00,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 10:14:00,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f3f479a[Count = 1] remaining members to acquire global barrier 2023-07-21 10:14:00,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:00,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:00,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:00,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:00,676 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,676 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:00,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:00,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 10:14:00,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f3f479a[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:00,678 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 10:14:00,678 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,679 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,679 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,679 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:14:00,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,679 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:14:00,679 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:00,679 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:00,679 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,679 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:14:00,680 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. started... 2023-07-21 10:14:00,680 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,680 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:00,680 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ca6d0169a71524be3b62c30348be6ab2 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-21 10:14:00,680 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,680 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 10:14:00,680 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:14:00,680 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:14:00,680 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:00,680 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:00,680 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:14:00,681 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. started... 2023-07-21 10:14:00,681 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0c45cff7a92f89898d3acef62ed4a1a5 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-21 10:14:00,682 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:14:00,682 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:00,682 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:14:00,742 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/.tmp/cf/3c5aa6bb4a1c46ac990111e730780e70 2023-07-21 10:14:00,751 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/.tmp/cf/3c5aa6bb4a1c46ac990111e730780e70 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/cf/3c5aa6bb4a1c46ac990111e730780e70 2023-07-21 10:14:00,773 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/.tmp/cf/8b2e17fcd69b4253a3a71c95dbe70219 2023-07-21 10:14:00,774 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/cf/3c5aa6bb4a1c46ac990111e730780e70, entries=7, sequenceid=6, filesize=5.3 K 2023-07-21 10:14:00,777 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for ca6d0169a71524be3b62c30348be6ab2 in 96ms, sequenceid=6, compaction requested=false 2023-07-21 10:14:00,778 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ca6d0169a71524be3b62c30348be6ab2: 2023-07-21 10:14:00,779 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,779 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:00,779 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/cf/3c5aa6bb4a1c46ac990111e730780e70] hfiles 2023-07-21 10:14:00,779 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/cf/3c5aa6bb4a1c46ac990111e730780e70 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,808 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/.tmp/cf/8b2e17fcd69b4253a3a71c95dbe70219 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/cf/8b2e17fcd69b4253a3a71c95dbe70219 2023-07-21 10:14:00,826 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/cf/8b2e17fcd69b4253a3a71c95dbe70219, entries=43, sequenceid=6, filesize=7.7 K 2023-07-21 10:14:00,829 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 0c45cff7a92f89898d3acef62ed4a1a5 in 148ms, sequenceid=6, compaction requested=false 2023-07-21 10:14:00,829 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0c45cff7a92f89898d3acef62ed4a1a5: 2023-07-21 10:14:00,830 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,830 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:00,830 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/cf/8b2e17fcd69b4253a3a71c95dbe70219] hfiles 2023-07-21 10:14:00,830 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. completed. 2023-07-21 10:14:00,830 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:14:00,830 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/cf/8b2e17fcd69b4253a3a71c95dbe70219 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,830 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:00,830 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:00,830 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,830 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:14:00,830 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:14:00,831 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:14:00,831 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:00,831 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:14:00,831 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,840 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:14:00,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:00,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:00,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:00,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:00,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:00,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:00,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:00,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:14:00,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 10:14:00,863 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. completed. 2023-07-21 10:14:00,863 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:14:00,863 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:00,863 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:00,863 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,863 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 10:14:00,863 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:14:00,870 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 10:14:00,870 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:00,870 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 10:14:00,872 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:00,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:00,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,904 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:00,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:00,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:00,906 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-21 10:14:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:00,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase17.apache.org,42413,1689934328803': 2023-07-21 10:14:00,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 10:14:00,924 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 10:14:00,924 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:00,924 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:00,924 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,924 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:00,952 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,952 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:00,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,954 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,954 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:00,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:00,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:00,956 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:00,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:00,958 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,958 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:00,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:00,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:00,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:00,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:00,976 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:00,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,982 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:00,988 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:00,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:00,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:01,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,000 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:01,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:01,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:01,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:01,004 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:01,012 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:01,035 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:01,035 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:01,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:01,035 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:01,035 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:01,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:01,035 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:01,035 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,035 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:01,036 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:01,036 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,036 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:01,036 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,036 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:01,036 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:01,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:01,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:01,036 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:01,036 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:01,038 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,038 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:01,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:01,036 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:01,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:01,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:01,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:01,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 10:14:01,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,350 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:01,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689934439789Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689934441036 (+1247 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689934441038 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689934441080 (+42 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689934441182 (+102 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689934441349 (+167 ms) 2023-07-21 10:14:01,354 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 10:14:01,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.5630 sec 2023-07-21 10:14:01,907 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:01,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 10:14:01,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:14:01,971 DEBUG [Listener at jenkins-hbase17.apache.org/33881] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:14:01,988 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:14:01,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35819] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 10:14:01,991 DEBUG [Listener at jenkins-hbase17.apache.org/33881] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:14:02,003 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:14:02,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38115] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 10:14:02,005 DEBUG [Listener at jenkins-hbase17.apache.org/33881] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 10:14:02,030 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:37414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 10:14:02,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42413] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 10:14:02,034 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:14:02,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:02,039 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:14:02,040 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:14:02,040 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-21 10:14:02,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 10:14:02,044 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,044 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,045 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc empty. 2023-07-21 10:14:02,045 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d empty. 2023-07-21 10:14:02,045 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,046 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,046 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 10:14:02,110 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-21 10:14:02,113 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 499cce7fc8208835d5b23b7176247fbc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:14:02,115 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => f5ae4e4766f5cb2a2821ba5979d01a1d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:14:02,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 10:14:02,178 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:02,178 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:02,178 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing f5ae4e4766f5cb2a2821ba5979d01a1d, disabling compactions & flushes 2023-07-21 10:14:02,178 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 499cce7fc8208835d5b23b7176247fbc, disabling compactions & flushes 2023-07-21 10:14:02,178 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,178 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,178 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,178 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,178 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. after waiting 0 ms 2023-07-21 10:14:02,179 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. after waiting 0 ms 2023-07-21 10:14:02,179 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,179 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,179 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,179 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,179 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for f5ae4e4766f5cb2a2821ba5979d01a1d: 2023-07-21 10:14:02,179 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 499cce7fc8208835d5b23b7176247fbc: 2023-07-21 10:14:02,185 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:14:02,186 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934442186"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934442186"}]},"ts":"1689934442186"} 2023-07-21 10:14:02,186 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934442186"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934442186"}]},"ts":"1689934442186"} 2023-07-21 10:14:02,189 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:14:02,192 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:14:02,192 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934442192"}]},"ts":"1689934442192"} 2023-07-21 10:14:02,195 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-21 10:14:02,199 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:14:02,201 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:14:02,202 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:14:02,202 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:14:02,202 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:14:02,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=499cce7fc8208835d5b23b7176247fbc, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5ae4e4766f5cb2a2821ba5979d01a1d, ASSIGN}] 2023-07-21 10:14:02,209 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5ae4e4766f5cb2a2821ba5979d01a1d, ASSIGN 2023-07-21 10:14:02,210 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=499cce7fc8208835d5b23b7176247fbc, ASSIGN 2023-07-21 10:14:02,219 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=499cce7fc8208835d5b23b7176247fbc, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35819,1689934328736; forceNewPlan=false, retain=false 2023-07-21 10:14:02,219 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5ae4e4766f5cb2a2821ba5979d01a1d, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,42413,1689934328803; forceNewPlan=false, retain=false 2023-07-21 10:14:02,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 10:14:02,370 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:14:02,373 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f5ae4e4766f5cb2a2821ba5979d01a1d, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:02,373 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=499cce7fc8208835d5b23b7176247fbc, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:02,373 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934442373"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934442373"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934442373"}]},"ts":"1689934442373"} 2023-07-21 10:14:02,373 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934442373"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934442373"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934442373"}]},"ts":"1689934442373"} 2023-07-21 10:14:02,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure f5ae4e4766f5cb2a2821ba5979d01a1d, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:14:02,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 499cce7fc8208835d5b23b7176247fbc, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:14:02,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5ae4e4766f5cb2a2821ba5979d01a1d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.', STARTKEY => '2', ENDKEY => ''} 2023-07-21 10:14:02,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 499cce7fc8208835d5b23b7176247fbc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.', STARTKEY => '', ENDKEY => '2'} 2023-07-21 10:14:02,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. service=AccessControlService 2023-07-21 10:14:02,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:02,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:02,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. service=AccessControlService 2023-07-21 10:14:02,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:02,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:02,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,540 INFO [StoreOpener-499cce7fc8208835d5b23b7176247fbc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,540 INFO [StoreOpener-f5ae4e4766f5cb2a2821ba5979d01a1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,542 DEBUG [StoreOpener-f5ae4e4766f5cb2a2821ba5979d01a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/cf 2023-07-21 10:14:02,542 DEBUG [StoreOpener-f5ae4e4766f5cb2a2821ba5979d01a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/cf 2023-07-21 10:14:02,542 DEBUG [StoreOpener-499cce7fc8208835d5b23b7176247fbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/cf 2023-07-21 10:14:02,542 DEBUG [StoreOpener-499cce7fc8208835d5b23b7176247fbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/cf 2023-07-21 10:14:02,542 INFO [StoreOpener-f5ae4e4766f5cb2a2821ba5979d01a1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5ae4e4766f5cb2a2821ba5979d01a1d columnFamilyName cf 2023-07-21 10:14:02,542 INFO [StoreOpener-499cce7fc8208835d5b23b7176247fbc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 499cce7fc8208835d5b23b7176247fbc columnFamilyName cf 2023-07-21 10:14:02,543 INFO [StoreOpener-f5ae4e4766f5cb2a2821ba5979d01a1d-1] regionserver.HStore(310): Store=f5ae4e4766f5cb2a2821ba5979d01a1d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:02,543 INFO [StoreOpener-499cce7fc8208835d5b23b7176247fbc-1] regionserver.HStore(310): Store=499cce7fc8208835d5b23b7176247fbc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:02,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:02,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:02,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened f5ae4e4766f5cb2a2821ba5979d01a1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67625059, jitterRate=0.007691904902458191}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:02,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 499cce7fc8208835d5b23b7176247fbc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59490563, jitterRate=-0.1135215312242508}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:02,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for f5ae4e4766f5cb2a2821ba5979d01a1d: 2023-07-21 10:14:02,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 499cce7fc8208835d5b23b7176247fbc: 2023-07-21 10:14:02,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc., pid=70, masterSystemTime=1689934442527 2023-07-21 10:14:02,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d., pid=69, masterSystemTime=1689934442527 2023-07-21 10:14:02,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,553 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=499cce7fc8208835d5b23b7176247fbc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:02,554 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934442553"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934442553"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934442553"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934442553"}]},"ts":"1689934442553"} 2023-07-21 10:14:02,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,554 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=f5ae4e4766f5cb2a2821ba5979d01a1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:02,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934442554"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934442554"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934442554"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934442554"}]},"ts":"1689934442554"} 2023-07-21 10:14:02,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-21 10:14:02,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 499cce7fc8208835d5b23b7176247fbc, server=jenkins-hbase17.apache.org,35819,1689934328736 in 180 msec 2023-07-21 10:14:02,559 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-21 10:14:02,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure f5ae4e4766f5cb2a2821ba5979d01a1d, server=jenkins-hbase17.apache.org,42413,1689934328803 in 182 msec 2023-07-21 10:14:02,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=499cce7fc8208835d5b23b7176247fbc, ASSIGN in 357 msec 2023-07-21 10:14:02,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-21 10:14:02,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5ae4e4766f5cb2a2821ba5979d01a1d, ASSIGN in 357 msec 2023-07-21 10:14:02,562 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:14:02,563 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934442563"}]},"ts":"1689934442563"} 2023-07-21 10:14:02,566 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-21 10:14:02,568 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:14:02,569 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-21 10:14:02,572 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 10:14:02,573 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:02,573 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:02,573 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:02,573 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:02,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:02,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:02,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:02,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:02,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:02,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:02,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:02,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:02,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 540 msec 2023-07-21 10:14:02,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 10:14:02,648 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-21 10:14:02,695 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$2(1952): Client=jenkins//136.243.18.41 merge regions 499cce7fc8208835d5b23b7176247fbc, f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[499cce7fc8208835d5b23b7176247fbc, f5ae4e4766f5cb2a2821ba5979d01a1d], force=true 2023-07-21 10:14:02,710 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[499cce7fc8208835d5b23b7176247fbc, f5ae4e4766f5cb2a2821ba5979d01a1d], force=true 2023-07-21 10:14:02,710 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[499cce7fc8208835d5b23b7176247fbc, f5ae4e4766f5cb2a2821ba5979d01a1d], force=true 2023-07-21 10:14:02,710 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[499cce7fc8208835d5b23b7176247fbc, f5ae4e4766f5cb2a2821ba5979d01a1d], force=true 2023-07-21 10:14:02,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:02,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=499cce7fc8208835d5b23b7176247fbc, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5ae4e4766f5cb2a2821ba5979d01a1d, UNASSIGN}] 2023-07-21 10:14:02,753 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5ae4e4766f5cb2a2821ba5979d01a1d, UNASSIGN 2023-07-21 10:14:02,755 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=499cce7fc8208835d5b23b7176247fbc, UNASSIGN 2023-07-21 10:14:02,757 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=f5ae4e4766f5cb2a2821ba5979d01a1d, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:02,757 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934442757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934442757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934442757"}]},"ts":"1689934442757"} 2023-07-21 10:14:02,757 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=499cce7fc8208835d5b23b7176247fbc, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:02,758 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934442757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934442757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934442757"}]},"ts":"1689934442757"} 2023-07-21 10:14:02,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure f5ae4e4766f5cb2a2821ba5979d01a1d, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:14:02,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 499cce7fc8208835d5b23b7176247fbc, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:14:02,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:02,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:02,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing f5ae4e4766f5cb2a2821ba5979d01a1d, disabling compactions & flushes 2023-07-21 10:14:02,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. after waiting 0 ms 2023-07-21 10:14:02,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing f5ae4e4766f5cb2a2821ba5979d01a1d 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 10:14:02,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:02,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 499cce7fc8208835d5b23b7176247fbc, disabling compactions & flushes 2023-07-21 10:14:02,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. after waiting 0 ms 2023-07-21 10:14:02,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:02,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 499cce7fc8208835d5b23b7176247fbc 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 10:14:02,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/.tmp/cf/daf15dada8124f8b82de5739b8471bfd 2023-07-21 10:14:02,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/.tmp/cf/daf15dada8124f8b82de5739b8471bfd as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/cf/daf15dada8124f8b82de5739b8471bfd 2023-07-21 10:14:02,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/.tmp/cf/722a28544d8f4d26ba83b9628aebd36b 2023-07-21 10:14:02,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/.tmp/cf/722a28544d8f4d26ba83b9628aebd36b as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/cf/722a28544d8f4d26ba83b9628aebd36b 2023-07-21 10:14:02,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/cf/daf15dada8124f8b82de5739b8471bfd, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 10:14:02,977 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for f5ae4e4766f5cb2a2821ba5979d01a1d in 61ms, sequenceid=5, compaction requested=false 2023-07-21 10:14:02,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 10:14:02,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/cf/722a28544d8f4d26ba83b9628aebd36b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 10:14:02,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 10:14:02,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:02,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 499cce7fc8208835d5b23b7176247fbc in 77ms, sequenceid=5, compaction requested=false 2023-07-21 10:14:02,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d. 2023-07-21 10:14:02,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for f5ae4e4766f5cb2a2821ba5979d01a1d: 2023-07-21 10:14:03,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:03,002 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=f5ae4e4766f5cb2a2821ba5979d01a1d, regionState=CLOSED 2023-07-21 10:14:03,002 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934443002"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934443002"}]},"ts":"1689934443002"} 2023-07-21 10:14:03,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-21 10:14:03,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure f5ae4e4766f5cb2a2821ba5979d01a1d, server=jenkins-hbase17.apache.org,42413,1689934328803 in 247 msec 2023-07-21 10:14:03,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 10:14:03,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:03,013 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f5ae4e4766f5cb2a2821ba5979d01a1d, UNASSIGN in 263 msec 2023-07-21 10:14:03,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc. 2023-07-21 10:14:03,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 499cce7fc8208835d5b23b7176247fbc: 2023-07-21 10:14:03,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:03,019 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=499cce7fc8208835d5b23b7176247fbc, regionState=CLOSED 2023-07-21 10:14:03,019 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689934443019"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934443019"}]},"ts":"1689934443019"} 2023-07-21 10:14:03,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:03,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-21 10:14:03,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 499cce7fc8208835d5b23b7176247fbc, server=jenkins-hbase17.apache.org,35819,1689934328736 in 258 msec 2023-07-21 10:14:03,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-21 10:14:03,027 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=499cce7fc8208835d5b23b7176247fbc, UNASSIGN in 282 msec 2023-07-21 10:14:03,232 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-21 10:14:03,235 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442033.499cce7fc8208835d5b23b7176247fbc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:03,235 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689934442033.f5ae4e4766f5cb2a2821ba5979d01a1d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:03,235 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:03,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:03,372 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=58bdaccb61f4092f71e50320ce768f67, ASSIGN}] 2023-07-21 10:14:03,380 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=58bdaccb61f4092f71e50320ce768f67, ASSIGN 2023-07-21 10:14:03,382 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=58bdaccb61f4092f71e50320ce768f67, ASSIGN; state=MERGED, location=jenkins-hbase17.apache.org,35819,1689934328736; forceNewPlan=false, retain=false 2023-07-21 10:14:03,532 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 10:14:03,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=58bdaccb61f4092f71e50320ce768f67, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:03,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689934443535"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934443535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934443535"}]},"ts":"1689934443535"} 2023-07-21 10:14:03,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 58bdaccb61f4092f71e50320ce768f67, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:14:03,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. 2023-07-21 10:14:03,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 58bdaccb61f4092f71e50320ce768f67, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.', STARTKEY => '', ENDKEY => ''} 2023-07-21 10:14:03,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. service=AccessControlService 2023-07-21 10:14:03,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:03,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:03,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:03,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:03,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:03,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/.regioninfo 2023-07-21 10:14:03,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:03,830 INFO [StoreOpener-58bdaccb61f4092f71e50320ce768f67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:03,832 DEBUG [StoreOpener-58bdaccb61f4092f71e50320ce768f67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf 2023-07-21 10:14:03,832 DEBUG [StoreOpener-58bdaccb61f4092f71e50320ce768f67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf 2023-07-21 10:14:03,833 INFO [StoreOpener-58bdaccb61f4092f71e50320ce768f67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58bdaccb61f4092f71e50320ce768f67 columnFamilyName cf 2023-07-21 10:14:03,881 DEBUG [StoreOpener-58bdaccb61f4092f71e50320ce768f67-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/722a28544d8f4d26ba83b9628aebd36b.499cce7fc8208835d5b23b7176247fbc->hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/cf/722a28544d8f4d26ba83b9628aebd36b-top 2023-07-21 10:14:03,899 DEBUG [StoreOpener-58bdaccb61f4092f71e50320ce768f67-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/daf15dada8124f8b82de5739b8471bfd.f5ae4e4766f5cb2a2821ba5979d01a1d->hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/cf/daf15dada8124f8b82de5739b8471bfd-top 2023-07-21 10:14:03,901 INFO [StoreOpener-58bdaccb61f4092f71e50320ce768f67-1] regionserver.HStore(310): Store=58bdaccb61f4092f71e50320ce768f67/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:03,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:03,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:03,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:03,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 58bdaccb61f4092f71e50320ce768f67; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60775397, jitterRate=-0.09437601268291473}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:03,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 58bdaccb61f4092f71e50320ce768f67: 2023-07-21 10:14:03,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67., pid=77, masterSystemTime=1689934443693 2023-07-21 10:14:03,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.,because compaction is disabled. 2023-07-21 10:14:03,924 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=58bdaccb61f4092f71e50320ce768f67, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:03,924 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689934443923"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934443923"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934443923"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934443923"}]},"ts":"1689934443923"} 2023-07-21 10:14:03,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. 2023-07-21 10:14:03,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. 2023-07-21 10:14:03,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-21 10:14:03,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 58bdaccb61f4092f71e50320ce768f67, server=jenkins-hbase17.apache.org,35819,1689934328736 in 391 msec 2023-07-21 10:14:03,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-21 10:14:03,942 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=58bdaccb61f4092f71e50320ce768f67, ASSIGN in 565 msec 2023-07-21 10:14:03,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[499cce7fc8208835d5b23b7176247fbc, f5ae4e4766f5cb2a2821ba5979d01a1d], force=true in 1.2420 sec 2023-07-21 10:14:04,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 10:14:04,826 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-21 10:14:04,826 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 10:14:04,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934444826 (current time:1689934444826). 2023-07-21 10:14:04,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:14:04,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x5cf04cf9 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:04,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36c58c4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:04,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:04,885 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:04,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cf04cf9 to 127.0.0.1:60277 2023-07-21 10:14:04,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:04,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x5cbef529 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:04,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f7edc3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:04,999 DEBUG [hconnection-0x184a860b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:05,009 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:43892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:05,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:05,029 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:56964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:05,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cbef529 to 127.0.0.1:60277 2023-07-21 10:14:05,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:05,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 10:14:05,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:14:05,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 10:14:05,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 10:14:05,039 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 10:14:05,040 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689935045040 2023-07-21 10:14:05,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 10:14:05,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,046 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:14:05,046 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:14:05,050 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 10:14:05,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 10:14:05,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 13 msec 2023-07-21 10:14:05,054 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 10:14:05,055 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689935045055 2023-07-21 10:14:05,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,142 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 10:14:05,142 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:05,144 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-21 10:14:05,144 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-21 10:14:05,145 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,145 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,146 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:05,146 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,146 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:05,146 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:05,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:05,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:05,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:05,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:05,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:05,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:05,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,151 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,151 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:05,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 10:14:05,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 10:14:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 10:14:05,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,155 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 10:14:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 10:14:05,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,156 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 10:14:05,160 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:05,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 10:14:05,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:05,163 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:05,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,166 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 10:14:05,166 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:05,175 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,175 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 10:14:05,175 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:05,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,194 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 10:14:05,194 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:05,178 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 10:14:05,196 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 10:14:05,196 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 10:14:05,193 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 10:14:05,196 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 10:14:05,196 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 10:14:05,199 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 10:14:05,199 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 10:14:05,199 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 10:14:05,201 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,201 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,201 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:05,202 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:05,203 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,203 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:05,202 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,203 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:05,203 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,203 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:05,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:05,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:05,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-21 10:14:05,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45a0c704[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:05,213 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-21 10:14:05,213 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,214 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,214 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,214 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 10:14:05,214 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,214 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:05,214 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 10:14:05,215 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 10:14:05,215 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:14:05,216 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,216 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 10:14:05,216 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:05,216 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 10:14:05,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,216 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 10:14:05,217 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 10:14:05,217 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:14:05,218 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 10:14:05,218 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:05,218 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 10:14:05,225 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:05,225 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. 2023-07-21 10:14:05,225 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:05,226 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. started... 2023-07-21 10:14:05,228 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 58bdaccb61f4092f71e50320ce768f67: 2023-07-21 10:14:05,229 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,229 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:05,229 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/722a28544d8f4d26ba83b9628aebd36b.499cce7fc8208835d5b23b7176247fbc->hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/cf/722a28544d8f4d26ba83b9628aebd36b-top, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/daf15dada8124f8b82de5739b8471bfd.f5ae4e4766f5cb2a2821ba5979d01a1d->hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/cf/daf15dada8124f8b82de5739b8471bfd-top] hfiles 2023-07-21 10:14:05,229 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/722a28544d8f4d26ba83b9628aebd36b.499cce7fc8208835d5b23b7176247fbc for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,230 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/daf15dada8124f8b82de5739b8471bfd.f5ae4e4766f5cb2a2821ba5979d01a1d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,288 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. completed. 2023-07-21 10:14:05,288 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. 2023-07-21 10:14:05,288 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:05,288 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:05,288 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,288 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 10:14:05,288 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:14:05,293 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 10:14:05,293 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:05,293 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 10:14:05,294 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:05,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:05,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:05,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:05,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:05,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:05,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase17.apache.org,35819,1689934328736': 2023-07-21 10:14:05,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-21 10:14:05,300 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-21 10:14:05,300 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:05,300 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:05,300 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,300 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:05,302 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,302 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,303 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:05,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,302 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:05,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,303 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,303 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:05,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:05,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:05,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:05,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,304 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:05,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:05,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:05,306 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,306 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:05,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:05,307 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:05,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,310 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:05,310 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,311 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:05,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:05,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:05,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:05,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:05,314 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:05,314 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:05,315 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,315 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:05,315 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:05,315 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,315 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,315 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:05,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:05,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:05,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:05,363 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:05,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 10:14:05,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:05,365 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:05,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,604 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-21 10:14:05,604 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,606 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689934445041Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689934445314 (+273 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689934445314Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689934445326 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689934445413 (+87 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689934445604 (+191 ms) 2023-07-21 10:14:05,609 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 10:14:05,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 564 msec 2023-07-21 10:14:05,665 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:05,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 10:14:05,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:14:05,667 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667 2023-07-21 10:14:05,667 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46589, tgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667, rawTgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667, srcFsUri=hdfs://localhost.localdomain:46589, srcDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:14:05,701 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:14:05,701 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1188127455_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,701 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a, snapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-21 10:14:05,725 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:05,818 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,819 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,819 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,819 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,820 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,820 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,820 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,921 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop-4542583385243219826.jar 2023-07-21 10:14:05,922 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,922 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,923 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,924 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,924 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,925 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:05,925 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:14:05,926 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:14:05,927 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:14:05,927 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:14:05,928 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:14:05,928 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:14:05,929 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:14:05,929 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:14:05,933 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:14:05,933 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:14:05,934 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:05,935 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:05,935 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:05,935 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:05,936 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:05,936 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:05,937 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:06,839 WARN [Listener at jenkins-hbase17.apache.org/33881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:14:06,842 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-21 10:14:06,847 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-21 10:14:07,121 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:14:07,121 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:14:07,434 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0005_000001 (auth:SIMPLE) 2023-07-21 10:14:08,041 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:14:15,346 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0005_000001 (auth:SIMPLE) 2023-07-21 10:14:18,140 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0005_000001 (auth:SIMPLE) 2023-07-21 10:14:32,606 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:14:32,612 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:14:32,690 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:32,691 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:14:32,691 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:14:32,692 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:32,692 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 10:14:32,692 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 10:14:32,692 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:32,693 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 10:14:32,693 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934445667/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 10:14:32,741 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:32,744 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:32,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:32,754 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934472754"}]},"ts":"1689934472754"} 2023-07-21 10:14:32,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 10:14:32,761 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-21 10:14:32,765 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-21 10:14:32,766 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=58bdaccb61f4092f71e50320ce768f67, UNASSIGN}] 2023-07-21 10:14:32,768 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=58bdaccb61f4092f71e50320ce768f67, UNASSIGN 2023-07-21 10:14:32,769 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=58bdaccb61f4092f71e50320ce768f67, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:32,769 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689934472769"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934472769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934472769"}]},"ts":"1689934472769"} 2023-07-21 10:14:32,771 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 58bdaccb61f4092f71e50320ce768f67, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:14:32,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 10:14:32,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:32,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 58bdaccb61f4092f71e50320ce768f67, disabling compactions & flushes 2023-07-21 10:14:32,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. 2023-07-21 10:14:32,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. 2023-07-21 10:14:32,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. after waiting 0 ms 2023-07-21 10:14:32,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. 2023-07-21 10:14:33,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-21 10:14:33,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:33,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67. 2023-07-21 10:14:33,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 58bdaccb61f4092f71e50320ce768f67: 2023-07-21 10:14:33,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:33,041 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=58bdaccb61f4092f71e50320ce768f67, regionState=CLOSED 2023-07-21 10:14:33,042 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689934473041"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934473041"}]},"ts":"1689934473041"} 2023-07-21 10:14:33,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-21 10:14:33,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 58bdaccb61f4092f71e50320ce768f67, server=jenkins-hbase17.apache.org,35819,1689934328736 in 279 msec 2023-07-21 10:14:33,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-21 10:14:33,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=58bdaccb61f4092f71e50320ce768f67, UNASSIGN in 295 msec 2023-07-21 10:14:33,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 10:14:33,066 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934473065"}]},"ts":"1689934473065"} 2023-07-21 10:14:33,067 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-21 10:14:33,069 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-21 10:14:33,072 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 326 msec 2023-07-21 10:14:33,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 10:14:33,372 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-21 10:14:33,372 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,381 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,383 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,386 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,397 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,398 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,397 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,398 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 10:14:33,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 10:14:33,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 10:14:33,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 10:14:33,405 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,405 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:33,405 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,405 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:33,405 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,405 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:33,405 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,405 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:33,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 10:14:33,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:33,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:33,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:33,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:33,428 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:33,432 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:33,437 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:33,442 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/recovered.edits] 2023-07-21 10:14:33,443 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/recovered.edits] 2023-07-21 10:14:33,450 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/recovered.edits] 2023-07-21 10:14:33,452 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/cf/722a28544d8f4d26ba83b9628aebd36b to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/cf/722a28544d8f4d26ba83b9628aebd36b 2023-07-21 10:14:33,456 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/recovered.edits/8.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc/recovered.edits/8.seqid 2023-07-21 10:14:33,457 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:33,460 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/cf/daf15dada8124f8b82de5739b8471bfd to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/cf/daf15dada8124f8b82de5739b8471bfd 2023-07-21 10:14:33,469 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/722a28544d8f4d26ba83b9628aebd36b.499cce7fc8208835d5b23b7176247fbc to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/722a28544d8f4d26ba83b9628aebd36b.499cce7fc8208835d5b23b7176247fbc 2023-07-21 10:14:33,471 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/daf15dada8124f8b82de5739b8471bfd.f5ae4e4766f5cb2a2821ba5979d01a1d to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/cf/daf15dada8124f8b82de5739b8471bfd.f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:33,474 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/recovered.edits/12.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67/recovered.edits/12.seqid 2023-07-21 10:14:33,475 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/58bdaccb61f4092f71e50320ce768f67 2023-07-21 10:14:33,479 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/recovered.edits/8.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d/recovered.edits/8.seqid 2023-07-21 10:14:33,479 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f5ae4e4766f5cb2a2821ba5979d01a1d 2023-07-21 10:14:33,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 10:14:33,513 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 10:14:33,525 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,536 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-21 10:14:33,557 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-21 10:14:33,560 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,560 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-21 10:14:33,560 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934473560"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:33,582 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-21 10:14:33,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 58bdaccb61f4092f71e50320ce768f67, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689934442034.58bdaccb61f4092f71e50320ce768f67.', STARTKEY => '', ENDKEY => ''}] 2023-07-21 10:14:33,582 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-21 10:14:33,582 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934473582"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:33,594 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-21 10:14:33,595 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:33,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 223 msec 2023-07-21 10:14:33,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 10:14:33,715 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-21 10:14:33,715 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:33,716 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:33,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:33,722 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934473722"}]},"ts":"1689934473722"} 2023-07-21 10:14:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 10:14:33,727 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-21 10:14:33,729 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-21 10:14:33,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca6d0169a71524be3b62c30348be6ab2, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c45cff7a92f89898d3acef62ed4a1a5, UNASSIGN}] 2023-07-21 10:14:33,732 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c45cff7a92f89898d3acef62ed4a1a5, UNASSIGN 2023-07-21 10:14:33,734 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca6d0169a71524be3b62c30348be6ab2, UNASSIGN 2023-07-21 10:14:33,744 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ca6d0169a71524be3b62c30348be6ab2, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:33,745 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934473736"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934473736"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934473736"}]},"ts":"1689934473736"} 2023-07-21 10:14:33,745 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0c45cff7a92f89898d3acef62ed4a1a5, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:33,745 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934473736"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934473736"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934473736"}]},"ts":"1689934473736"} 2023-07-21 10:14:33,749 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure ca6d0169a71524be3b62c30348be6ab2, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:14:33,751 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 0c45cff7a92f89898d3acef62ed4a1a5, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:14:33,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 10:14:33,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:14:33,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing ca6d0169a71524be3b62c30348be6ab2, disabling compactions & flushes 2023-07-21 10:14:33,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:14:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:14:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. after waiting 0 ms 2023-07-21 10:14:33,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:14:33,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:14:33,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 0c45cff7a92f89898d3acef62ed4a1a5, disabling compactions & flushes 2023-07-21 10:14:33,916 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:14:33,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:14:33,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. after waiting 0 ms 2023-07-21 10:14:33,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:14:34,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:14:34,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 10:14:34,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:34,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5. 2023-07-21 10:14:34,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 0c45cff7a92f89898d3acef62ed4a1a5: 2023-07-21 10:14:34,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:14:34,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:34,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2. 2023-07-21 10:14:34,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for ca6d0169a71524be3b62c30348be6ab2: 2023-07-21 10:14:34,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:14:34,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:14:34,084 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ca6d0169a71524be3b62c30348be6ab2, regionState=CLOSED 2023-07-21 10:14:34,084 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934474084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934474084"}]},"ts":"1689934474084"} 2023-07-21 10:14:34,086 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0c45cff7a92f89898d3acef62ed4a1a5, regionState=CLOSED 2023-07-21 10:14:34,086 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689934474086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934474086"}]},"ts":"1689934474086"} 2023-07-21 10:14:34,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-21 10:14:34,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure ca6d0169a71524be3b62c30348be6ab2, server=jenkins-hbase17.apache.org,38115,1689934328849 in 337 msec 2023-07-21 10:14:34,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-21 10:14:34,091 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 0c45cff7a92f89898d3acef62ed4a1a5, server=jenkins-hbase17.apache.org,42413,1689934328803 in 338 msec 2023-07-21 10:14:34,092 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ca6d0169a71524be3b62c30348be6ab2, UNASSIGN in 361 msec 2023-07-21 10:14:34,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-21 10:14:34,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0c45cff7a92f89898d3acef62ed4a1a5, UNASSIGN in 361 msec 2023-07-21 10:14:34,094 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934474094"}]},"ts":"1689934474094"} 2023-07-21 10:14:34,097 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-21 10:14:34,098 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-21 10:14:34,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 389 msec 2023-07-21 10:14:34,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 10:14:34,347 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-21 10:14:34,348 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,361 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,363 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,366 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,368 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,368 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,369 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,369 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,369 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 10:14:34,369 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 10:14:34,370 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 10:14:34,372 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,372 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:34,372 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,372 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,372 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:34,373 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:34,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 10:14:34,373 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,373 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:34,373 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 10:14:34,381 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:14:34,381 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:14:34,389 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/recovered.edits] 2023-07-21 10:14:34,390 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/recovered.edits] 2023-07-21 10:14:34,403 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/cf/3c5aa6bb4a1c46ac990111e730780e70 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/cf/3c5aa6bb4a1c46ac990111e730780e70 2023-07-21 10:14:34,405 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/cf/8b2e17fcd69b4253a3a71c95dbe70219 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/cf/8b2e17fcd69b4253a3a71c95dbe70219 2023-07-21 10:14:34,417 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2/recovered.edits/9.seqid 2023-07-21 10:14:34,418 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5/recovered.edits/9.seqid 2023-07-21 10:14:34,418 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ca6d0169a71524be3b62c30348be6ab2 2023-07-21 10:14:34,419 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0c45cff7a92f89898d3acef62ed4a1a5 2023-07-21 10:14:34,419 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 10:14:34,435 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,456 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-21 10:14:34,478 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-21 10:14:34,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 10:14:34,480 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,480 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-21 10:14:34,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934474480"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:34,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934474480"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:34,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:14:34,483 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ca6d0169a71524be3b62c30348be6ab2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689934436106.ca6d0169a71524be3b62c30348be6ab2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0c45cff7a92f89898d3acef62ed4a1a5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689934436106.0c45cff7a92f89898d3acef62ed4a1a5.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:14:34,483 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-21 10:14:34,483 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934474483"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:34,488 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-21 10:14:34,504 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,506 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 156 msec 2023-07-21 10:14:34,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 10:14:34,689 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-21 10:14:34,706 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 10:14:34,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 10:14:34,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 10:14:34,717 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-21 10:14:34,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 10:14:34,765 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=755 (was 746) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:36454 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:50016 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (911300582) connection to jenkins-hbase17.apache.org/136.243.18.41:44065 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase17:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:60794 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1602 (was 1259) - SystemLoadAverage LEAK? -, ProcessCount=197 (was 195) - ProcessCount LEAK? -, AvailableMemoryMB=910 (was 602) - AvailableMemoryMB LEAK? - 2023-07-21 10:14:34,765 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-21 10:14:34,847 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=755, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=1602, ProcessCount=197, AvailableMemoryMB=901 2023-07-21 10:14:34,847 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-21 10:14:34,849 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:14:34,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:34,857 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:14:34,858 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-21 10:14:34,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:34,860 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:14:34,865 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:34,866 DEBUG [HFileArchiver-24] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62 empty. 2023-07-21 10:14:34,867 DEBUG [HFileArchiver-24] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:34,870 DEBUG [HFileArchiver-25] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:34,877 DEBUG [HFileArchiver-25] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce empty. 2023-07-21 10:14:34,881 DEBUG [HFileArchiver-25] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:34,881 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 10:14:34,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:35,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:35,423 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 10:14:35,430 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8cb13577498a9bf5a6893ac3a5989e62, NAME => 'testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:14:35,437 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1da2633433b49d5918050e2c7f9ad6ce, NAME => 'testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:14:35,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:35,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:35,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8cb13577498a9bf5a6893ac3a5989e62, disabling compactions & flushes 2023-07-21 10:14:35,649 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:35,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:35,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. after waiting 0 ms 2023-07-21 10:14:35,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:35,649 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:35,649 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8cb13577498a9bf5a6893ac3a5989e62: 2023-07-21 10:14:36,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:36,049 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:36,049 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1da2633433b49d5918050e2c7f9ad6ce, disabling compactions & flushes 2023-07-21 10:14:36,049 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:36,049 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:36,049 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. after waiting 0 ms 2023-07-21 10:14:36,049 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:36,049 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:36,049 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1da2633433b49d5918050e2c7f9ad6ce: 2023-07-21 10:14:36,053 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:14:36,055 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934476055"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934476055"}]},"ts":"1689934476055"} 2023-07-21 10:14:36,055 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934476055"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934476055"}]},"ts":"1689934476055"} 2023-07-21 10:14:36,065 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:14:36,066 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:14:36,066 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934476066"}]},"ts":"1689934476066"} 2023-07-21 10:14:36,077 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 10:14:36,092 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:14:36,093 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:14:36,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:14:36,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:14:36,094 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:14:36,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8cb13577498a9bf5a6893ac3a5989e62, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1da2633433b49d5918050e2c7f9ad6ce, ASSIGN}] 2023-07-21 10:14:36,096 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1da2633433b49d5918050e2c7f9ad6ce, ASSIGN 2023-07-21 10:14:36,099 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8cb13577498a9bf5a6893ac3a5989e62, ASSIGN 2023-07-21 10:14:36,100 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1da2633433b49d5918050e2c7f9ad6ce, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,38115,1689934328849; forceNewPlan=false, retain=false 2023-07-21 10:14:36,101 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8cb13577498a9bf5a6893ac3a5989e62, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35819,1689934328736; forceNewPlan=false, retain=false 2023-07-21 10:14:36,250 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:14:36,256 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1da2633433b49d5918050e2c7f9ad6ce, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:36,256 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934476256"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934476256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934476256"}]},"ts":"1689934476256"} 2023-07-21 10:14:36,257 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8cb13577498a9bf5a6893ac3a5989e62, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:36,257 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934476257"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934476257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934476257"}]},"ts":"1689934476257"} 2023-07-21 10:14:36,272 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 1da2633433b49d5918050e2c7f9ad6ce, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:14:36,280 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 8cb13577498a9bf5a6893ac3a5989e62, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:14:36,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:36,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8cb13577498a9bf5a6893ac3a5989e62, NAME => 'testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:14:36,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. service=AccessControlService 2023-07-21 10:14:36,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:36,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:36,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:36,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:36,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:36,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:36,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1da2633433b49d5918050e2c7f9ad6ce, NAME => 'testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:14:36,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. service=AccessControlService 2023-07-21 10:14:36,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:36,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:36,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:36,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:36,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:36,476 INFO [StoreOpener-8cb13577498a9bf5a6893ac3a5989e62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:36,478 DEBUG [StoreOpener-8cb13577498a9bf5a6893ac3a5989e62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/cf 2023-07-21 10:14:36,479 DEBUG [StoreOpener-8cb13577498a9bf5a6893ac3a5989e62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/cf 2023-07-21 10:14:36,479 INFO [StoreOpener-8cb13577498a9bf5a6893ac3a5989e62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8cb13577498a9bf5a6893ac3a5989e62 columnFamilyName cf 2023-07-21 10:14:36,480 INFO [StoreOpener-8cb13577498a9bf5a6893ac3a5989e62-1] regionserver.HStore(310): Store=8cb13577498a9bf5a6893ac3a5989e62/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:36,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:36,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:36,488 INFO [StoreOpener-1da2633433b49d5918050e2c7f9ad6ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:36,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:36,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:36,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8cb13577498a9bf5a6893ac3a5989e62; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59597523, jitterRate=-0.11192770302295685}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:36,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8cb13577498a9bf5a6893ac3a5989e62: 2023-07-21 10:14:36,499 DEBUG [StoreOpener-1da2633433b49d5918050e2c7f9ad6ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/cf 2023-07-21 10:14:36,499 DEBUG [StoreOpener-1da2633433b49d5918050e2c7f9ad6ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/cf 2023-07-21 10:14:36,500 INFO [StoreOpener-1da2633433b49d5918050e2c7f9ad6ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1da2633433b49d5918050e2c7f9ad6ce columnFamilyName cf 2023-07-21 10:14:36,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62., pid=94, masterSystemTime=1689934476442 2023-07-21 10:14:36,501 INFO [StoreOpener-1da2633433b49d5918050e2c7f9ad6ce-1] regionserver.HStore(310): Store=1da2633433b49d5918050e2c7f9ad6ce/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:36,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:36,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:36,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:36,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:36,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:36,512 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8cb13577498a9bf5a6893ac3a5989e62, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:36,512 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934476512"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934476512"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934476512"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934476512"}]},"ts":"1689934476512"} 2023-07-21 10:14:36,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:36,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 1da2633433b49d5918050e2c7f9ad6ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68547476, jitterRate=0.021436989307403564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:36,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 1da2633433b49d5918050e2c7f9ad6ce: 2023-07-21 10:14:36,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce., pid=93, masterSystemTime=1689934476435 2023-07-21 10:14:36,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:36,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:36,522 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1da2633433b49d5918050e2c7f9ad6ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:36,522 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934476522"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934476522"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934476522"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934476522"}]},"ts":"1689934476522"} 2023-07-21 10:14:36,525 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-21 10:14:36,525 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 8cb13577498a9bf5a6893ac3a5989e62, server=jenkins-hbase17.apache.org,35819,1689934328736 in 241 msec 2023-07-21 10:14:36,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8cb13577498a9bf5a6893ac3a5989e62, ASSIGN in 431 msec 2023-07-21 10:14:36,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-21 10:14:36,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 1da2633433b49d5918050e2c7f9ad6ce, server=jenkins-hbase17.apache.org,38115,1689934328849 in 252 msec 2023-07-21 10:14:36,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-21 10:14:36,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1da2633433b49d5918050e2c7f9ad6ce, ASSIGN in 433 msec 2023-07-21 10:14:36,531 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:14:36,531 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934476531"}]},"ts":"1689934476531"} 2023-07-21 10:14:36,532 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 10:14:36,535 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:14:36,535 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-21 10:14:36,546 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:14:36,547 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:36,547 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:36,547 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:36,547 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:36,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:36,549 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:36,549 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:36,549 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:36,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 1.6990 sec 2023-07-21 10:14:37,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 10:14:37,005 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-21 10:14:37,005 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-21 10:14:37,006 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:14:37,011 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-21 10:14:37,011 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:14:37,011 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-21 10:14:37,033 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:37,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934477033 (current time:1689934477033). 2023-07-21 10:14:37,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:14:37,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x4e200eb9 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:37,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30237127, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:37,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:37,080 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:37,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e200eb9 to 127.0.0.1:60277 2023-07-21 10:14:37,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:37,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x743b2919 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:37,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a20b4e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:37,130 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0005_000001 (auth:SIMPLE) 2023-07-21 10:14:37,137 DEBUG [hconnection-0x11a150cb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:37,145 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:51600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:37,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:37,156 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:40276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:37,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x743b2919 to 127.0.0.1:60277 2023-07-21 10:14:37,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:37,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:14:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:14:37,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:37,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:37,171 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:37,172 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689935077172 2023-07-21 10:14:37,172 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:37,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:37,180 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:14:37,180 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:14:37,183 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:37,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:37,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 16 msec 2023-07-21 10:14:37,199 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:37,203 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689935077203 2023-07-21 10:14:37,284 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:37,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:37,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:37,286 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:37,486 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:37,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:37,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:37,488 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:37,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:37,763 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-21 10:14:37,763 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:37,763 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 10:14:37,763 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 10:14:37,764 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:37,764 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:37,790 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:37,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:37,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:37,793 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:14:38,293 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:38,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:38,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:38,308 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-21 10:14:38,477 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:38,477 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:38,477 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:38,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:38,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:38,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:38,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:38,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 10:14:38,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:38,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:38,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:38,480 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:38,480 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:38,480 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:38,488 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:38,491 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:38,491 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:38,497 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:38,497 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:38,501 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:38,501 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:38,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:38,814 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:14:39,221 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,222 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,222 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:39,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 10:14:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 10:14:39,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,225 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:39,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,228 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:39,228 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:39,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,228 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:39,244 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:39,243 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:39,244 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:39,244 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:39,246 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:39,246 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:39,246 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:39,309 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:39,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:39,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:39,314 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-07-21 10:14:39,395 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:39,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:39,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,396 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,400 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,401 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:39,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,536 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,536 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:39,537 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,537 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:39,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 10:14:39,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b2a13a[Count = 1] remaining members to acquire global barrier 2023-07-21 10:14:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:39,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:39,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:39,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:39,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 10:14:39,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b2a13a[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:39,543 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 10:14:39,543 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,544 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,544 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,545 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,545 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:39,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,545 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:39,545 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:39,545 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:14:39,545 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:39,545 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,546 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,546 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:39,547 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:39,547 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:39,547 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:39,549 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:39,557 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:39,557 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:39,556 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:39,557 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:39,557 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. started... 2023-07-21 10:14:39,573 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8cb13577498a9bf5a6893ac3a5989e62: 2023-07-21 10:14:39,573 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,573 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:39,573 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:14:39,576 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:39,576 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. started... 2023-07-21 10:14:39,578 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1da2633433b49d5918050e2c7f9ad6ce: 2023-07-21 10:14:39,579 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,579 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:39,579 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:14:39,644 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. completed. 2023-07-21 10:14:39,644 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:39,644 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:39,644 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:39,644 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,645 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:39,645 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:14:39,647 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:39,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:39,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:39,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,651 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:39,651 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:39,651 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:39,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:39,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35819,1689934328736': 2023-07-21 10:14:39,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 10:14:39,700 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. completed. 2023-07-21 10:14:39,700 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:39,700 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:39,700 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:39,700 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,700 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:39,700 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:14:39,703 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:39,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:39,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:39,708 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:39,708 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:39,708 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:39,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:14:39,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 10:14:39,715 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 10:14:39,715 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:39,715 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:39,715 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,715 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:39,716 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,717 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:39,717 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,717 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,717 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:39,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:39,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,718 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,720 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:39,720 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,726 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,726 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:39,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:39,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:39,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:39,739 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,740 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,743 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,747 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:39,747 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:39,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,748 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:39,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:39,748 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:39,752 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:39,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:39,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:39,752 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:39,752 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:39,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:39,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:39,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:39,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:39,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:39,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:39,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:39,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:40,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 10:14:40,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:40,016 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:40,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689934477172Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689934479764 (+2592 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689934479764Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689934479783 (+19 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689934479827 (+44 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689934480015 (+188 ms) 2023-07-21 10:14:40,024 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:40,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 2.8500 sec 2023-07-21 10:14:41,315 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:41,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:41,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:14:41,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35819] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:14:41,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38115] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:14:41,356 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:41,356 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:41,357 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:14:41,387 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:41,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934481387 (current time:1689934481387). 2023-07-21 10:14:41,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:14:41,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x14c60a3a to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:41,419 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-21 10:14:41,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ffa2761, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:41,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:41,426 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:41,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14c60a3a to 127.0.0.1:60277 2023-07-21 10:14:41,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:41,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x566c1add to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:41,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72df5df0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:41,480 DEBUG [hconnection-0x2cc0bde5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:41,482 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:46152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:41,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:41,520 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:41,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x566c1add to 127.0.0.1:60277 2023-07-21 10:14:41,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:41,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 10:14:41,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:14:41,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:41,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:41,542 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:41,543 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689935081543 2023-07-21 10:14:41,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 10:14:41,544 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:41,544 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:14:41,544 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:14:41,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:41,555 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 10:14:41,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 19 msec 2023-07-21 10:14:41,571 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:41,572 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689935081572 2023-07-21 10:14:41,644 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:41,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:41,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:41,646 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:41,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,700 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-21 10:14:41,700 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:41,700 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 10:14:41,700 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 10:14:41,701 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,701 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,702 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:41,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:41,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:41,702 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:41,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,703 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:41,703 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:41,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 10:14:41,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,703 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:41,704 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:41,704 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:41,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:41,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:41,704 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,705 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:41,705 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:41,704 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:41,704 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:41,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:41,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:41,712 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:41,712 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:41,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,712 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:41,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 10:14:41,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 10:14:41,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,714 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:41,714 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 10:14:41,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,715 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:41,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,716 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 10:14:41,716 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:41,716 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,715 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:41,721 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:41,736 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:41,736 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:41,727 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 10:14:41,736 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 10:14:41,736 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 10:14:41,736 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,736 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:41,738 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,740 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:41,740 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,740 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:41,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:41,741 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:41,741 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,741 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,741 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:41,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:41,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:41,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:41,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:41,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:41,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 10:14:41,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bf41bc2[Count = 1] remaining members to acquire global barrier 2023-07-21 10:14:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:41,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 10:14:41,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4bf41bc2[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:41,790 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 10:14:41,790 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,791 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,791 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,791 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:41,791 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,791 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:41,791 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:41,791 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,792 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. started... 2023-07-21 10:14:41,792 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:41,792 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:41,792 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:14:41,792 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1da2633433b49d5918050e2c7f9ad6ce 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-21 10:14:41,792 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 10:14:41,793 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:41,793 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:41,793 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:41,793 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:41,793 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:41,793 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:41,795 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:41,801 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:41,801 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:41,802 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. started... 2023-07-21 10:14:41,802 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8cb13577498a9bf5a6893ac3a5989e62 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-21 10:14:41,846 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:41,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:41,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:41,847 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:41,869 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/.tmp/cf/e48d8509672d4d7b99e5452461dc9664 2023-07-21 10:14:41,875 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/.tmp/cf/046c294ecb6446f59dd88eef86748c41 2023-07-21 10:14:41,897 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/.tmp/cf/046c294ecb6446f59dd88eef86748c41 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/cf/046c294ecb6446f59dd88eef86748c41 2023-07-21 10:14:41,904 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/.tmp/cf/e48d8509672d4d7b99e5452461dc9664 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/cf/e48d8509672d4d7b99e5452461dc9664 2023-07-21 10:14:41,910 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/cf/046c294ecb6446f59dd88eef86748c41, entries=47, sequenceid=6, filesize=8 K 2023-07-21 10:14:41,912 INFO [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 1da2633433b49d5918050e2c7f9ad6ce in 120ms, sequenceid=6, compaction requested=false 2023-07-21 10:14:41,918 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1da2633433b49d5918050e2c7f9ad6ce: 2023-07-21 10:14:41,918 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,918 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:41,918 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/cf/046c294ecb6446f59dd88eef86748c41] hfiles 2023-07-21 10:14:41,918 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/cf/046c294ecb6446f59dd88eef86748c41 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,928 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/cf/e48d8509672d4d7b99e5452461dc9664, entries=3, sequenceid=6, filesize=5.0 K 2023-07-21 10:14:41,940 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 8cb13577498a9bf5a6893ac3a5989e62 in 138ms, sequenceid=6, compaction requested=false 2023-07-21 10:14:41,940 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8cb13577498a9bf5a6893ac3a5989e62: 2023-07-21 10:14:41,941 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:41,957 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:41,957 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/cf/e48d8509672d4d7b99e5452461dc9664] hfiles 2023-07-21 10:14:41,957 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/cf/e48d8509672d4d7b99e5452461dc9664 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,005 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. completed. 2023-07-21 10:14:42,005 DEBUG [rs(jenkins-hbase17.apache.org,38115,1689934328849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:42,005 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:42,005 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:42,005 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,006 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:42,006 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:14:42,012 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:42,012 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:42,012 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:42,016 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:42,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:42,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,38115,1689934328849': 2023-07-21 10:14:42,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 10:14:42,073 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. completed. 2023-07-21 10:14:42,073 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:42,073 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:42,073 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:42,073 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,073 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 10:14:42,073 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:14:42,077 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 10:14:42,077 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:42,077 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 10:14:42,077 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:42,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:42,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase17.apache.org,35819,1689934328736': 2023-07-21 10:14:42,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 10:14:42,089 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 10:14:42,089 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:42,089 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:42,089 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,090 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:42,091 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,091 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:42,091 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,091 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:42,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,092 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,092 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:42,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,093 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:42,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:42,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:42,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,112 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:42,113 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,125 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,129 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,130 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,134 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:42,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:42,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:42,140 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:42,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:42,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:42,141 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:42,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:42,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:42,140 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:42,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:42,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-21 10:14:42,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:42,148 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:42,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:42,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:42,150 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:14:42,650 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:42,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:42,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:42,652 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-21 10:14:42,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 10:14:42,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,794 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:42,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689934481544Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689934482141 (+597 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689934482141Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689934482192 (+51 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689934482665 (+473 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689934482794 (+129 ms) 2023-07-21 10:14:42,798 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 10:14:42,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.2490 sec 2023-07-21 10:14:43,656 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:43,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 10:14:43,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:14:43,657 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657 2023-07-21 10:14:43,658 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46589, tgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657, rawTgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657, srcFsUri=hdfs://localhost.localdomain:46589, srcDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:14:43,717 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:14:43,717 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1569605052_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,717 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a, snapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-21 10:14:43,742 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:43,843 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,843 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,844 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,844 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,845 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,845 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,845 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,935 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop-2965615637341224109.jar 2023-07-21 10:14:43,936 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,936 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,937 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,937 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,937 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,938 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:14:43,938 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:14:43,939 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:14:43,939 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:14:43,940 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:14:43,940 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:14:43,941 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:14:43,941 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:14:43,942 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:14:43,942 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:14:43,943 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:14:43,943 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:43,944 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:43,944 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:43,944 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:43,945 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:14:43,945 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:43,946 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:14:45,545 WARN [DataStreamer for file /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689934339986_0006/libjars/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-21 10:14:46,271 WARN [Listener at jenkins-hbase17.apache.org/33881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:14:46,273 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-21 10:14:46,376 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:14:46,377 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:14:46,738 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0006_000001 (auth:SIMPLE) 2023-07-21 10:14:52,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0006_000001 (auth:SIMPLE) 2023-07-21 10:14:55,779 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:14:55,782 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:14:55,812 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:55,812 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:14:55,819 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:14:55,819 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:55,820 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 10:14:55,820 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 10:14:55,821 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:55,823 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 10:14:55,823 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934483657/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 10:14:55,857 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-21 10:14:55,858 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testEmptyExportFileSystemState 2023-07-21 10:14:55,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:55,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 10:14:55,863 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934495863"}]},"ts":"1689934495863"} 2023-07-21 10:14:55,865 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 10:14:55,866 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-21 10:14:55,868 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8cb13577498a9bf5a6893ac3a5989e62, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1da2633433b49d5918050e2c7f9ad6ce, UNASSIGN}] 2023-07-21 10:14:55,877 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1da2633433b49d5918050e2c7f9ad6ce, UNASSIGN 2023-07-21 10:14:55,887 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8cb13577498a9bf5a6893ac3a5989e62, UNASSIGN 2023-07-21 10:14:55,889 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1da2633433b49d5918050e2c7f9ad6ce, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:55,889 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934495889"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934495889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934495889"}]},"ts":"1689934495889"} 2023-07-21 10:14:55,890 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8cb13577498a9bf5a6893ac3a5989e62, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:55,890 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934495889"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934495889"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934495889"}]},"ts":"1689934495889"} 2023-07-21 10:14:55,894 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 1da2633433b49d5918050e2c7f9ad6ce, server=jenkins-hbase17.apache.org,38115,1689934328849}] 2023-07-21 10:14:55,897 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 8cb13577498a9bf5a6893ac3a5989e62, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:14:55,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 10:14:56,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:56,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1da2633433b49d5918050e2c7f9ad6ce, disabling compactions & flushes 2023-07-21 10:14:56,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:56,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:56,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. after waiting 0 ms 2023-07-21 10:14:56,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:56,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:56,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8cb13577498a9bf5a6893ac3a5989e62, disabling compactions & flushes 2023-07-21 10:14:56,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:56,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:56,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. after waiting 0 ms 2023-07-21 10:14:56,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:56,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:14:56,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:14:56,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:56,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:14:56,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62. 2023-07-21 10:14:56,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8cb13577498a9bf5a6893ac3a5989e62: 2023-07-21 10:14:56,088 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce. 2023-07-21 10:14:56,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1da2633433b49d5918050e2c7f9ad6ce: 2023-07-21 10:14:56,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:56,090 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8cb13577498a9bf5a6893ac3a5989e62, regionState=CLOSED 2023-07-21 10:14:56,090 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934496090"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934496090"}]},"ts":"1689934496090"} 2023-07-21 10:14:56,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:56,091 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1da2633433b49d5918050e2c7f9ad6ce, regionState=CLOSED 2023-07-21 10:14:56,091 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689934496091"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934496091"}]},"ts":"1689934496091"} 2023-07-21 10:14:56,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-21 10:14:56,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 8cb13577498a9bf5a6893ac3a5989e62, server=jenkins-hbase17.apache.org,35819,1689934328736 in 195 msec 2023-07-21 10:14:56,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-21 10:14:56,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 1da2633433b49d5918050e2c7f9ad6ce, server=jenkins-hbase17.apache.org,38115,1689934328849 in 199 msec 2023-07-21 10:14:56,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8cb13577498a9bf5a6893ac3a5989e62, UNASSIGN in 225 msec 2023-07-21 10:14:56,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-21 10:14:56,096 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1da2633433b49d5918050e2c7f9ad6ce, UNASSIGN in 226 msec 2023-07-21 10:14:56,096 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934496096"}]},"ts":"1689934496096"} 2023-07-21 10:14:56,098 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 10:14:56,099 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-21 10:14:56,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 242 msec 2023-07-21 10:14:56,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 10:14:56,165 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-21 10:14:56,166 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,170 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,172 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,173 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,175 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,175 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,175 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,175 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 10:14:56,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 10:14:56,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 10:14:56,177 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,177 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:56,177 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,177 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:56,177 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:56,177 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-21 10:14:56,178 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 10:14:56,178 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,178 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:56,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 10:14:56,188 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:56,188 DEBUG [HFileArchiver-26] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:56,190 DEBUG [HFileArchiver-26] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/recovered.edits] 2023-07-21 10:14:56,190 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/recovered.edits] 2023-07-21 10:14:56,195 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/cf/046c294ecb6446f59dd88eef86748c41 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/cf/046c294ecb6446f59dd88eef86748c41 2023-07-21 10:14:56,196 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/cf/e48d8509672d4d7b99e5452461dc9664 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/cf/e48d8509672d4d7b99e5452461dc9664 2023-07-21 10:14:56,199 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce/recovered.edits/9.seqid 2023-07-21 10:14:56,199 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1da2633433b49d5918050e2c7f9ad6ce 2023-07-21 10:14:56,201 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62/recovered.edits/9.seqid 2023-07-21 10:14:56,202 DEBUG [HFileArchiver-26] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testEmptyExportFileSystemState/8cb13577498a9bf5a6893ac3a5989e62 2023-07-21 10:14:56,202 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 10:14:56,204 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,213 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-21 10:14:56,215 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-21 10:14:56,216 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,216 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-21 10:14:56,216 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934496216"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:56,217 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934496216"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:56,225 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:14:56,225 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8cb13577498a9bf5a6893ac3a5989e62, NAME => 'testtb-testEmptyExportFileSystemState,,1689934474849.8cb13577498a9bf5a6893ac3a5989e62.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1da2633433b49d5918050e2c7f9ad6ce, NAME => 'testtb-testEmptyExportFileSystemState,1,1689934474849.1da2633433b49d5918050e2c7f9ad6ce.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:14:56,225 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-21 10:14:56,226 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934496225"}]},"ts":"9223372036854775807"} 2023-07-21 10:14:56,230 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-21 10:14:56,237 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 10:14:56,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 71 msec 2023-07-21 10:14:56,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 10:14:56,280 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-21 10:14:56,289 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-21 10:14:56,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:56,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-21 10:14:56,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-21 10:14:56,346 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 755) Potentially hanging thread: IPC Client (911300582) connection to jenkins-hbase17.apache.org/136.243.18.41:37047 from appattempt_1689934339986_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1848179726_1 at /127.0.0.1:40784 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4726 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:54586 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-48 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (911300582) connection to jenkins-hbase17.apache.org/136.243.18.41:45505 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:37730 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1848179726_1 at /127.0.0.1:37690 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (911300582) connection to jenkins-hbase17.apache.org/136.243.18.41:46883 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:40798 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1504 (was 1602), ProcessCount=194 (was 197), AvailableMemoryMB=1648 (was 901) - AvailableMemoryMB LEAK? - 2023-07-21 10:14:56,346 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-21 10:14:56,376 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=1504, ProcessCount=194, AvailableMemoryMB=1643 2023-07-21 10:14:56,376 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-21 10:14:56,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$4(2112): Client=jenkins//136.243.18.41 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 10:14:56,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:56,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 10:14:56,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(700): Client=jenkins//136.243.18.41 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-21 10:14:56,391 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 10:14:56,396 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649 2023-07-21 10:14:56,396 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:14:56,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:14:56,396 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649 empty. 2023-07-21 10:14:56,399 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6 empty. 2023-07-21 10:14:56,399 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649 2023-07-21 10:14:56,399 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:14:56,399 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 10:14:56,473 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-21 10:14:56,478 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a0d11f11da3728fc66762edd4aff7c6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:14:56,478 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 73265d33c17f734c282a79133b9b6649, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp 2023-07-21 10:14:56,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:14:56,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:56,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 8a0d11f11da3728fc66762edd4aff7c6, disabling compactions & flushes 2023-07-21 10:14:56,642 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:14:56,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:14:56,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. after waiting 0 ms 2023-07-21 10:14:56,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:14:56,642 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:14:56,642 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 8a0d11f11da3728fc66762edd4aff7c6: 2023-07-21 10:14:56,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:14:57,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:14:57,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:57,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 73265d33c17f734c282a79133b9b6649, disabling compactions & flushes 2023-07-21 10:14:57,056 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:14:57,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:14:57,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. after waiting 0 ms 2023-07-21 10:14:57,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:14:57,056 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:14:57,056 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 73265d33c17f734c282a79133b9b6649: 2023-07-21 10:14:57,073 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 10:14:57,079 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934497079"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934497079"}]},"ts":"1689934497079"} 2023-07-21 10:14:57,080 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934497079"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934497079"}]},"ts":"1689934497079"} 2023-07-21 10:14:57,106 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 10:14:57,124 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 10:14:57,125 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934497124"}]},"ts":"1689934497124"} 2023-07-21 10:14:57,133 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-21 10:14:57,147 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase17.apache.org=0} racks are {/default-rack=0} 2023-07-21 10:14:57,152 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 10:14:57,152 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 10:14:57,152 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 10:14:57,152 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 10:14:57,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=73265d33c17f734c282a79133b9b6649, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a0d11f11da3728fc66762edd4aff7c6, ASSIGN}] 2023-07-21 10:14:57,181 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=73265d33c17f734c282a79133b9b6649, ASSIGN 2023-07-21 10:14:57,190 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a0d11f11da3728fc66762edd4aff7c6, ASSIGN 2023-07-21 10:14:57,191 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=73265d33c17f734c282a79133b9b6649, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,35819,1689934328736; forceNewPlan=false, retain=false 2023-07-21 10:14:57,193 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a0d11f11da3728fc66762edd4aff7c6, ASSIGN; state=OFFLINE, location=jenkins-hbase17.apache.org,42413,1689934328803; forceNewPlan=false, retain=false 2023-07-21 10:14:57,342 INFO [jenkins-hbase17:38671] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 10:14:57,352 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8a0d11f11da3728fc66762edd4aff7c6, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:57,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934497352"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934497352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934497352"}]},"ts":"1689934497352"} 2023-07-21 10:14:57,352 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=73265d33c17f734c282a79133b9b6649, regionState=OPENING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:57,353 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934497352"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934497352"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934497352"}]},"ts":"1689934497352"} 2023-07-21 10:14:57,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 8a0d11f11da3728fc66762edd4aff7c6, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:14:57,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 73265d33c17f734c282a79133b9b6649, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:14:57,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:14:57,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:14:57,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 73265d33c17f734c282a79133b9b6649, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 10:14:57,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. service=AccessControlService 2023-07-21 10:14:57,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 73265d33c17f734c282a79133b9b6649 2023-07-21 10:14:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 73265d33c17f734c282a79133b9b6649 2023-07-21 10:14:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 73265d33c17f734c282a79133b9b6649 2023-07-21 10:14:57,565 INFO [StoreOpener-73265d33c17f734c282a79133b9b6649-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 73265d33c17f734c282a79133b9b6649 2023-07-21 10:14:57,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:14:57,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a0d11f11da3728fc66762edd4aff7c6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 10:14:57,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. service=AccessControlService 2023-07-21 10:14:57,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 10:14:57,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:14:57,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 10:14:57,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7894): checking encryption for 8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:14:57,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(7897): checking classloading for 8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:14:57,567 DEBUG [StoreOpener-73265d33c17f734c282a79133b9b6649-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/cf 2023-07-21 10:14:57,567 DEBUG [StoreOpener-73265d33c17f734c282a79133b9b6649-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/cf 2023-07-21 10:14:57,569 INFO [StoreOpener-73265d33c17f734c282a79133b9b6649-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 73265d33c17f734c282a79133b9b6649 columnFamilyName cf 2023-07-21 10:14:57,570 INFO [StoreOpener-73265d33c17f734c282a79133b9b6649-1] regionserver.HStore(310): Store=73265d33c17f734c282a79133b9b6649/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:57,573 INFO [StoreOpener-8a0d11f11da3728fc66762edd4aff7c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:14:57,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649 2023-07-21 10:14:57,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649 2023-07-21 10:14:57,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 73265d33c17f734c282a79133b9b6649 2023-07-21 10:14:57,585 DEBUG [StoreOpener-8a0d11f11da3728fc66762edd4aff7c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/cf 2023-07-21 10:14:57,586 DEBUG [StoreOpener-8a0d11f11da3728fc66762edd4aff7c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/cf 2023-07-21 10:14:57,586 INFO [StoreOpener-8a0d11f11da3728fc66762edd4aff7c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a0d11f11da3728fc66762edd4aff7c6 columnFamilyName cf 2023-07-21 10:14:57,593 INFO [StoreOpener-8a0d11f11da3728fc66762edd4aff7c6-1] regionserver.HStore(310): Store=8a0d11f11da3728fc66762edd4aff7c6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 10:14:57,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:14:57,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:57,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:14:57,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1055): writing seq id for 8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:14:57,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 73265d33c17f734c282a79133b9b6649; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59338249, jitterRate=-0.1157911866903305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:57,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 73265d33c17f734c282a79133b9b6649: 2023-07-21 10:14:57,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649., pid=109, masterSystemTime=1689934497538 2023-07-21 10:14:57,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 10:14:57,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1072): Opened 8a0d11f11da3728fc66762edd4aff7c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65035275, jitterRate=-0.030898883938789368}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 10:14:57,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(965): Region open journal for 8a0d11f11da3728fc66762edd4aff7c6: 2023-07-21 10:14:57,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6., pid=108, masterSystemTime=1689934497528 2023-07-21 10:14:57,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:14:57,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:14:57,635 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=73265d33c17f734c282a79133b9b6649, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:57,635 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934497634"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934497634"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934497634"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934497634"}]},"ts":"1689934497634"} 2023-07-21 10:14:57,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:14:57,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase17:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:14:57,651 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=8a0d11f11da3728fc66762edd4aff7c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:57,651 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934497650"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1689934497650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689934497650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689934497650"}]},"ts":"1689934497650"} 2023-07-21 10:14:57,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-21 10:14:57,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 73265d33c17f734c282a79133b9b6649, server=jenkins-hbase17.apache.org,35819,1689934328736 in 287 msec 2023-07-21 10:14:57,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=73265d33c17f734c282a79133b9b6649, ASSIGN in 506 msec 2023-07-21 10:14:57,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-21 10:14:57,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 8a0d11f11da3728fc66762edd4aff7c6, server=jenkins-hbase17.apache.org,42413,1689934328803 in 306 msec 2023-07-21 10:14:57,700 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-21 10:14:57,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a0d11f11da3728fc66762edd4aff7c6, ASSIGN in 534 msec 2023-07-21 10:14:57,703 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 10:14:57,703 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934497703"}]},"ts":"1689934497703"} 2023-07-21 10:14:57,705 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-21 10:14:57,707 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 10:14:57,708 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-21 10:14:57,729 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 10:14:57,737 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:57,737 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:57,737 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:57,738 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:14:57,747 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:57,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:57,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:57,755 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:57,756 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 10:14:57,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 1.3750 sec 2023-07-21 10:14:58,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 10:14:58,533 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-21 10:14:58,533 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-21 10:14:58,533 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:14:58,554 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-21 10:14:58,554 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:14:58,555 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-21 10:14:58,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:14:58,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934498579 (current time:1689934498579). 2023-07-21 10:14:58,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:14:58,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x33151fad to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:58,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4de7806d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:58,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:58,615 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:58,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33151fad to 127.0.0.1:60277 2023-07-21 10:14:58,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:58,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x1db1dffe to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:14:58,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6424392, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:14:58,680 DEBUG [hconnection-0x77574fdf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:58,693 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:58,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:14:58,732 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:14:58,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1db1dffe to 127.0.0.1:60277 2023-07-21 10:14:58,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:14:58,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 10:14:58,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:14:58,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:14:58,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:14:58,767 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:14:58,769 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689935098769 2023-07-21 10:14:58,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:14:58,770 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:14:58,770 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:14:58,771 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:14:58,779 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:14:58,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 30 msec 2023-07-21 10:14:58,792 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:14:58,798 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689935098798 2023-07-21 10:14:58,871 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:58,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:14:58,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,878 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 10:14:58,878 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:58,878 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 10:14:58,878 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 10:14:58,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:58,879 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:14:58,884 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,884 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,893 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:58,893 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:58,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:58,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:58,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:58,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:58,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,895 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:58,896 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:58,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:58,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:58,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 10:14:58,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,900 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:14:58,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,900 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:58,900 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:58,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 10:14:58,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,901 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:14:58,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 10:14:58,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,902 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:14:58,902 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,902 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:14:58,902 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:58,902 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:58,901 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,905 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:14:58,905 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:14:58,902 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:14:58,905 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:58,905 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:14:58,905 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:14:58,907 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:14:58,907 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:14:58,907 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:14:58,907 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:14:58,907 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:14:58,909 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:14:58,909 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:14:58,909 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:14:58,913 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,914 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:58,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:58,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:58,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:58,914 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,914 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:58,915 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,915 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,915 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:58,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:58,915 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,915 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:58,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:58,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,916 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,916 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:14:58,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:58,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:58,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:58,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:58,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 10:14:58,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e5286b1[Count = 1] remaining members to acquire global barrier 2023-07-21 10:14:58,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:58,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:58,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:58,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:58,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:58,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:58,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:58,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:58,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:58,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 10:14:58,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e5286b1[Count = 0] remaining members to acquire global barrier 2023-07-21 10:14:58,920 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 10:14:58,921 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,923 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:58,923 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:58,923 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:14:58,924 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,924 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,925 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:14:58,927 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:58,927 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:58,928 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:14:58,928 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:14:58,928 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:14:58,932 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,932 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:14:58,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,933 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:14:58,933 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:14:58,934 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:58,934 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:14:58,932 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. started... 2023-07-21 10:14:58,940 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:14:58,940 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:14:58,945 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a0d11f11da3728fc66762edd4aff7c6: 2023-07-21 10:14:58,945 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,945 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:58,945 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:14:58,946 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:14:58,952 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. started... 2023-07-21 10:14:58,969 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73265d33c17f734c282a79133b9b6649: 2023-07-21 10:14:58,969 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:58,969 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:14:58,969 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 10:14:58,999 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. completed. 2023-07-21 10:14:58,999 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:14:58,999 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:58,999 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:58,999 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:58,999 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:14:58,999 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:14:59,001 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:14:59,001 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:59,001 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:14:59,001 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:59,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:59,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:59,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:59,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:59,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,42413,1689934328803': 2023-07-21 10:14:59,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 10:14:59,080 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:59,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:14:59,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:59,087 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:14:59,387 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:59,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:14:59,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:59,392 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:14:59,420 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-21 10:14:59,437 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. completed. 2023-07-21 10:14:59,438 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:14:59,438 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:14:59,438 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:14:59,438 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,438 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:14:59,438 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:14:59,449 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,449 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:14:59,449 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:59,449 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:14:59,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:59,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:59,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,35819,1689934328736': 2023-07-21 10:14:59,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 10:14:59,456 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 10:14:59,456 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:14:59,456 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:14:59,456 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,456 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:14:59,459 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,459 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,459 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:59,460 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,460 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:59,460 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,460 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:59,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:14:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:14:59,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:59,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:59,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:59,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:59,461 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:59,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:59,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:14:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,462 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,462 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:14:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,470 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,470 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:14:59,471 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,474 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:59,474 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:59,474 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,474 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,474 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:59,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,474 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:59,474 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:59,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:59,474 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:14:59,475 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:14:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:59,474 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,475 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,475 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,475 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:14:59,475 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,475 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:14:59,475 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:14:59,475 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,475 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,474 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:14:59,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:14:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:14:59,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:59,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:59,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:14:59,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:14:59,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:14:59,892 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:14:59,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:14:59,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:14:59,895 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-21 10:15:00,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 10:15:00,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,105 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,105 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689934498771Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689934499474 (+703 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689934499474Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689934499488 (+14 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689934499584 (+96 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689934500104 (+520 ms) 2023-07-21 10:15:00,108 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:00,109 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.3320 sec 2023-07-21 10:15:00,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0006_000001 (auth:SIMPLE) 2023-07-21 10:15:00,895 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:00,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:00,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:15:00,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35819] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:15:00,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42413] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 10:15:00,909 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,909 DEBUG [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:15:00,909 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 10:15:00,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1583): Client=jenkins//136.243.18.41 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:15:00,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689934500921 (current time:1689934500921). 2023-07-21 10:15:00,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 10:15:00,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x7a031d71 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:15:00,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37678c59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:15:00,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:15:00,932 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:15:00,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a031d71 to 127.0.0.1:60277 2023-07-21 10:15:00,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:00,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(139): Connect 0x4f31cf06 to 127.0.0.1:60277 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 10:15:00,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dbbbb04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 10:15:00,941 DEBUG [hconnection-0x26b5ffae-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:15:00,945 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:41706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:15:00,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 10:15:00,953 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 136.243.18.41:33552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 10:15:00,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f31cf06 to 127.0.0.1:60277 2023-07-21 10:15:00,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:00,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 10:15:00,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 10:15:00,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:15:00,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:15:00,958 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:15:00,959 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689935100959 2023-07-21 10:15:00,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 10:15:00,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,960 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 10:15:00,960 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 10:15:00,962 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 10:15:00,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:00,963 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-21 10:15:00,965 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:00,966 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689935100966 2023-07-21 10:15:00,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,985 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 10:15:00,985 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:00,987 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 10:15:00,987 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 10:15:00,988 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,988 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,989 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:00,989 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:00,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:00,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:00,989 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:00,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 10:15:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,991 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:15:00,992 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 10:15:00,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,992 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:15:00,990 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:00,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,992 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:15:00,992 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:00,993 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:00,993 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:00,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 10:15:00,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,993 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 10:15:00,993 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:00,993 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 10:15:00,993 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,995 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:15:00,996 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 10:15:00,996 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:00,995 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:15:00,996 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 10:15:00,996 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:15:00,996 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:15:00,997 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,997 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:00,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:00,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:00,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:00,998 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,998 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:15:00,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:00,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:00,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:00,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:01,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,42413,1689934328803' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 10:15:01,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d89e498[Count = 1] remaining members to acquire global barrier 2023-07-21 10:15:01,005 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:15:01,005 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 10:15:01,006 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:15:01,005 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 10:15:01,006 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,38115,1689934328849' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:15:01,006 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 10:15:01,008 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,010 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,010 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:15:01,010 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,011 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,011 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 10:15:01,011 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:01,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:01,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase17.apache.org,35819,1689934328736' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 10:15:01,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d89e498[Count = 0] remaining members to acquire global barrier 2023-07-21 10:15:01,013 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 10:15:01,013 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,014 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,014 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,014 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,014 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:15:01,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,015 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:15:01,016 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,016 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,016 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 10:15:01,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,017 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 10:15:01,017 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:15:01,017 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,38115,1689934328849' in zk 2023-07-21 10:15:01,017 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:15:01,017 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:15:01,017 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 10:15:01,017 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 10:15:01,017 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:15:01,017 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:15:01,017 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. started... 2023-07-21 10:15:01,017 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. started... 2023-07-21 10:15:01,017 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 73265d33c17f734c282a79133b9b6649 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-21 10:15:01,017 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a0d11f11da3728fc66762edd4aff7c6 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-21 10:15:01,018 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:15:01,018 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:01,018 DEBUG [member: 'jenkins-hbase17.apache.org,38115,1689934328849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:15:01,052 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=467 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/.tmp/cf/aa702575fc56482dad4062f641006056 2023-07-21 10:15:01,055 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.80 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/.tmp/cf/afa072417d2143e18d57e3c7e27bb6dd 2023-07-21 10:15:01,058 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/.tmp/cf/aa702575fc56482dad4062f641006056 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/cf/aa702575fc56482dad4062f641006056 2023-07-21 10:15:01,059 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/.tmp/cf/afa072417d2143e18d57e3c7e27bb6dd as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/cf/afa072417d2143e18d57e3c7e27bb6dd 2023-07-21 10:15:01,061 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:01,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:01,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:01,062 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 10:15:01,064 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/cf/aa702575fc56482dad4062f641006056, entries=7, sequenceid=6, filesize=5.3 K 2023-07-21 10:15:01,065 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/cf/afa072417d2143e18d57e3c7e27bb6dd, entries=43, sequenceid=6, filesize=7.7 K 2023-07-21 10:15:01,065 INFO [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 73265d33c17f734c282a79133b9b6649 in 48ms, sequenceid=6, compaction requested=false 2023-07-21 10:15:01,066 INFO [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 8a0d11f11da3728fc66762edd4aff7c6 in 48ms, sequenceid=6, compaction requested=false 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 73265d33c17f734c282a79133b9b6649: 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a0d11f11da3728fc66762edd4aff7c6: 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/cf/afa072417d2143e18d57e3c7e27bb6dd] hfiles 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/cf/aa702575fc56482dad4062f641006056] hfiles 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/cf/afa072417d2143e18d57e3c7e27bb6dd for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,067 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/cf/aa702575fc56482dad4062f641006056 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,079 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. completed. 2023-07-21 10:15:01,079 DEBUG [rs(jenkins-hbase17.apache.org,35819,1689934328736)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:15:01,079 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:15:01,080 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:15:01,080 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,080 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:15:01,080 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,35819,1689934328736' in zk 2023-07-21 10:15:01,080 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. completed. 2023-07-21 10:15:01,080 DEBUG [rs(jenkins-hbase17.apache.org,42413,1689934328803)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:15:01,080 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 10:15:01,080 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 10:15:01,080 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,080 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 10:15:01,080 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase17.apache.org,42413,1689934328803' in zk 2023-07-21 10:15:01,081 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,081 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:15:01,081 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:01,081 DEBUG [member: 'jenkins-hbase17.apache.org,35819,1689934328736' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:15:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:01,082 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 10:15:01,082 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,082 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:01,082 DEBUG [member: 'jenkins-hbase17.apache.org,42413,1689934328803' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 10:15:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:01,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,35819,1689934328736': 2023-07-21 10:15:01,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,35819,1689934328736' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 10:15:01,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:01,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:01,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:01,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:01,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase17.apache.org,42413,1689934328803': 2023-07-21 10:15:01,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase17.apache.org,42413,1689934328803' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 10:15:01,112 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 10:15:01,112 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 10:15:01,112 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 10:15:01,112 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,112 INFO [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 10:15:01,113 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,113 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 10:15:01,114 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 10:15:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,114 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 10:15:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,115 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,118 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,119 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 10:15:01,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,120 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 10:15:01,121 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,121 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 10:15:01,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:01,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 10:15:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:01,124 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 10:15:01,125 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:01,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,125 DEBUG [(jenkins-hbase17.apache.org,38671,1689934327089)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 10:15:01,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,125 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 10:15:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 10:15:01,125 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:01,127 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:01,127 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,127 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,262 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:01,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:01,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:01,263 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 10:15:01,564 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:01,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:01,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 10:15:01,565 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 10:15:01,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,700 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:15:01,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 10:15:01,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,850 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:01,850 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase17:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689934500959Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689934501125 (+166 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689934501125Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689934501149 (+24 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689934501616 (+467 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689934501849 (+233 ms) 2023-07-21 10:15:01,862 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 10:15:01,871 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 902 msec 2023-07-21 10:15:02,065 DEBUG [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 10:15:02,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 10:15:02,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 10:15:02,066 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066 2023-07-21 10:15:02,067 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost.localdomain:46589, tgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066, rawTgtDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066, srcFsUri=hdfs://localhost.localdomain:46589, srcDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:15:02,098 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a 2023-07-21 10:15:02,098 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2130986669_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:02,098 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost.localdomain:46589, inputRoot=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a, snapshotDir=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-21 10:15:02,123 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:02,171 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,172 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,173 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,173 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,174 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,174 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,175 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,292 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/hadoop-5994052003563393937.jar 2023-07-21 10:15:02,293 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,294 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,294 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,295 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,295 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,296 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 10:15:02,299 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 10:15:02,300 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 10:15:02,301 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 10:15:02,302 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 10:15:02,302 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 10:15:02,303 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 10:15:02,303 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 10:15:02,304 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 10:15:02,304 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 10:15:02,306 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 10:15:02,306 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:15:02,307 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:15:02,308 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:15:02,309 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:15:02,309 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 10:15:02,310 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:15:02,311 DEBUG [Listener at jenkins-hbase17.apache.org/33881] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 10:15:02,880 WARN [Listener at jenkins-hbase17.apache.org/33881] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 10:15:02,883 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-21 10:15:02,885 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-21 10:15:03,475 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:15:03,475 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 10:15:03,669 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0007_000001 (auth:SIMPLE) 2023-07-21 10:15:10,316 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0007_000001 (auth:SIMPLE) 2023-07-21 10:15:12,799 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0007_000001 (auth:SIMPLE) 2023-07-21 10:15:18,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0007_000001 (auth:SIMPLE) 2023-07-21 10:15:19,947 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 10:15:19,947 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 10:15:19,964 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:19,965 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 10:15:19,965 INFO [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 10:15:19,966 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:19,966 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 10:15:19,966 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 10:15:19,966 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1212122614_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:19,967 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 10:15:19,967 DEBUG [Listener at jenkins-hbase17.apache.org/33881] snapshot.TestExportSnapshot(367): hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/export-test/export-1689934502066/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 10:15:19,989 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:19,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$11(2418): Client=jenkins//136.243.18.41 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:19,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:19,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 10:15:20,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934520003"}]},"ts":"1689934520003"} 2023-07-21 10:15:20,004 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-21 10:15:20,005 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-21 10:15:20,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=73265d33c17f734c282a79133b9b6649, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a0d11f11da3728fc66762edd4aff7c6, UNASSIGN}] 2023-07-21 10:15:20,008 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a0d11f11da3728fc66762edd4aff7c6, UNASSIGN 2023-07-21 10:15:20,011 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=73265d33c17f734c282a79133b9b6649, UNASSIGN 2023-07-21 10:15:20,012 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8a0d11f11da3728fc66762edd4aff7c6, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:20,012 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=73265d33c17f734c282a79133b9b6649, regionState=CLOSING, regionLocation=jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:20,012 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934520012"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934520012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934520012"}]},"ts":"1689934520012"} 2023-07-21 10:15:20,012 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934520012"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1689934520012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689934520012"}]},"ts":"1689934520012"} 2023-07-21 10:15:20,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 8a0d11f11da3728fc66762edd4aff7c6, server=jenkins-hbase17.apache.org,42413,1689934328803}] 2023-07-21 10:15:20,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 73265d33c17f734c282a79133b9b6649, server=jenkins-hbase17.apache.org,35819,1689934328736}] 2023-07-21 10:15:20,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 10:15:20,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:15:20,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 8a0d11f11da3728fc66762edd4aff7c6, disabling compactions & flushes 2023-07-21 10:15:20,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:15:20,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:15:20,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. after waiting 0 ms 2023-07-21 10:15:20,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:15:20,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(111): Close 73265d33c17f734c282a79133b9b6649 2023-07-21 10:15:20,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 73265d33c17f734c282a79133b9b6649, disabling compactions & flushes 2023-07-21 10:15:20,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:15:20,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:15:20,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. after waiting 0 ms 2023-07-21 10:15:20,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:15:20,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:15:20,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:20,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6. 2023-07-21 10:15:20,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 8a0d11f11da3728fc66762edd4aff7c6: 2023-07-21 10:15:20,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:15:20,219 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=8a0d11f11da3728fc66762edd4aff7c6, regionState=CLOSED 2023-07-21 10:15:20,220 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934520219"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934520219"}]},"ts":"1689934520219"} 2023-07-21 10:15:20,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:15:20,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:20,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649. 2023-07-21 10:15:20,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 73265d33c17f734c282a79133b9b6649: 2023-07-21 10:15:20,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.UnassignRegionHandler(149): Closed 73265d33c17f734c282a79133b9b6649 2023-07-21 10:15:20,235 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=73265d33c17f734c282a79133b9b6649, regionState=CLOSED 2023-07-21 10:15:20,235 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689934520235"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689934520235"}]},"ts":"1689934520235"} 2023-07-21 10:15:20,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-21 10:15:20,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 8a0d11f11da3728fc66762edd4aff7c6, server=jenkins-hbase17.apache.org,42413,1689934328803 in 215 msec 2023-07-21 10:15:20,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=8a0d11f11da3728fc66762edd4aff7c6, UNASSIGN in 232 msec 2023-07-21 10:15:20,246 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-21 10:15:20,246 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 73265d33c17f734c282a79133b9b6649, server=jenkins-hbase17.apache.org,35819,1689934328736 in 219 msec 2023-07-21 10:15:20,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-21 10:15:20,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=73265d33c17f734c282a79133b9b6649, UNASSIGN in 240 msec 2023-07-21 10:15:20,258 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689934520257"}]},"ts":"1689934520257"} 2023-07-21 10:15:20,260 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-21 10:15:20,261 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-21 10:15:20,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 273 msec 2023-07-21 10:15:20,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 10:15:20,301 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-21 10:15:20,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.HMaster$5(2228): Client=jenkins//136.243.18.41 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,305 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,306 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,309 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38115] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,311 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,311 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,312 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,312 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 10:15:20,312 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 10:15:20,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 10:15:20,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 10:15:20,313 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,313 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:20,313 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,313 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:20,313 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:20,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,314 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 10:15:20,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 10:15:20,316 DEBUG [HFileArchiver-27] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649 2023-07-21 10:15:20,316 DEBUG [HFileArchiver-28] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:15:20,318 DEBUG [HFileArchiver-28] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/recovered.edits] 2023-07-21 10:15:20,318 DEBUG [HFileArchiver-27] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/cf, FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/recovered.edits] 2023-07-21 10:15:20,338 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/cf/afa072417d2143e18d57e3c7e27bb6dd to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/cf/afa072417d2143e18d57e3c7e27bb6dd 2023-07-21 10:15:20,338 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/cf/aa702575fc56482dad4062f641006056 to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/cf/aa702575fc56482dad4062f641006056 2023-07-21 10:15:20,342 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6/recovered.edits/9.seqid 2023-07-21 10:15:20,345 DEBUG [HFileArchiver-28] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/8a0d11f11da3728fc66762edd4aff7c6 2023-07-21 10:15:20,350 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/recovered.edits/9.seqid to hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649/recovered.edits/9.seqid 2023-07-21 10:15:20,351 DEBUG [HFileArchiver-27] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/73265d33c17f734c282a79133b9b6649 2023-07-21 10:15:20,351 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 10:15:20,357 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,370 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-21 10:15:20,388 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-21 10:15:20,391 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,392 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-21 10:15:20,392 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934520392"}]},"ts":"9223372036854775807"} 2023-07-21 10:15:20,392 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689934520392"}]},"ts":"9223372036854775807"} 2023-07-21 10:15:20,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 10:15:20,420 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 10:15:20,420 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 73265d33c17f734c282a79133b9b6649, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689934496381.73265d33c17f734c282a79133b9b6649.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8a0d11f11da3728fc66762edd4aff7c6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689934496381.8a0d11f11da3728fc66762edd4aff7c6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 10:15:20,420 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-21 10:15:20,420 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689934520420"}]},"ts":"9223372036854775807"} 2023-07-21 10:15:20,437 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-21 10:15:20,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 139 msec 2023-07-21 10:15:20,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 10:15:20,618 INFO [Listener at jenkins-hbase17.apache.org/33881] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-21 10:15:20,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 10:15:20,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] master.MasterRpcServices(751): Client=jenkins//136.243.18.41 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 10:15:20,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38671] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 10:15:20,699 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=768 (was 766) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-57 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-54 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:39132 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:49750 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MoveIntermediateToDone Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-55 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5335 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: MoveIntermediateToDone Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1839913784_1 at /127.0.0.1:58238 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MoveIntermediateToDone Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (911300582) connection to jenkins-hbase17.apache.org/136.243.18.41:40461 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3fefe1fa-shared-pool-56 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1839913784_1 at /127.0.0.1:49720 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212122614_17 at /127.0.0.1:58260 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1470 (was 1504), ProcessCount=200 (was 194) - ProcessCount LEAK? -, AvailableMemoryMB=1256 (was 1643) 2023-07-21 10:15:20,699 WARN [Listener at jenkins-hbase17.apache.org/33881] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-21 10:15:20,699 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-21 10:15:20,742 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-21 10:15:24,383 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689934339986_0007_000001 (auth:SIMPLE) 2023-07-21 10:15:25,811 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 10:15:34,899 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-21 10:15:49,019 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 10:15:49,020 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-21 10:15:49,134 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-21 10:15:49,154 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-21 10:15:49,155 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 10:15:49,214 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase17.apache.org:0 2023-07-21 10:15:49,319 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 10:15:49,319 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-21 10:15:49,319 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-21 10:15:49,319 INFO [Listener at jenkins-hbase17.apache.org/33881] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 10:15:49,319 DEBUG [Listener at jenkins-hbase17.apache.org/33881] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3505e662 to 127.0.0.1:60277 2023-07-21 10:15:49,319 DEBUG [Listener at jenkins-hbase17.apache.org/33881] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:49,320 DEBUG [Listener at jenkins-hbase17.apache.org/33881] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-21 10:15:49,320 DEBUG [Listener at jenkins-hbase17.apache.org/33881] util.JVMClusterUtil(257): Found active master hash=1294546124, stopped=false 2023-07-21 10:15:49,320 DEBUG [Listener at jenkins-hbase17.apache.org/33881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:49,320 DEBUG [Listener at jenkins-hbase17.apache.org/33881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 10:15:49,320 INFO [Listener at jenkins-hbase17.apache.org/33881] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:15:49,327 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 10:15:49,327 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 10:15:49,327 INFO [Listener at jenkins-hbase17.apache.org/33881] procedure2.ProcedureExecutor(629): Stopping 2023-07-21 10:15:49,327 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 10:15:49,327 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 10:15:49,327 DEBUG [Listener at jenkins-hbase17.apache.org/33881] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36f8b77d to 127.0.0.1:60277 2023-07-21 10:15:49,327 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:15:49,327 DEBUG [Listener at jenkins-hbase17.apache.org/33881] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:49,328 INFO [Listener at jenkins-hbase17.apache.org/33881] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,35819,1689934328736' ***** 2023-07-21 10:15:49,328 DEBUG [Listener at jenkins-hbase17.apache.org/33881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:49,328 INFO [Listener at jenkins-hbase17.apache.org/33881] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 10:15:49,328 INFO [Listener at jenkins-hbase17.apache.org/33881] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,42413,1689934328803' ***** 2023-07-21 10:15:49,328 DEBUG [Listener at jenkins-hbase17.apache.org/33881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:49,328 INFO [RS:0;jenkins-hbase17:35819] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 10:15:49,328 INFO [RS:0;jenkins-hbase17:35819] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 10:15:49,328 INFO [RS:0;jenkins-hbase17:35819] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 10:15:49,328 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:49,328 DEBUG [RS:0;jenkins-hbase17:35819] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1be80cf7 to 127.0.0.1:60277 2023-07-21 10:15:49,329 DEBUG [RS:0;jenkins-hbase17:35819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:49,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:15:49,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:15:49,328 INFO [Listener at jenkins-hbase17.apache.org/33881] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 10:15:49,329 INFO [Listener at jenkins-hbase17.apache.org/33881] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,38115,1689934328849' ***** 2023-07-21 10:15:49,329 DEBUG [Listener at jenkins-hbase17.apache.org/33881] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:49,329 INFO [Listener at jenkins-hbase17.apache.org/33881] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 10:15:49,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:15:49,330 INFO [RS:2;jenkins-hbase17:38115] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 10:15:49,330 INFO [RS:2;jenkins-hbase17:38115] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 10:15:49,330 INFO [RS:2;jenkins-hbase17:38115] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 10:15:49,330 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(3305): Received CLOSE for a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:15:49,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 10:15:49,332 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:49,332 INFO [RS:1;jenkins-hbase17:42413] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 10:15:49,332 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 10:15:49,332 INFO [RS:1;jenkins-hbase17:42413] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 10:15:49,332 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 10:15:49,332 INFO [RS:1;jenkins-hbase17:42413] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 10:15:49,332 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 10:15:49,332 DEBUG [RS:2;jenkins-hbase17:38115] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18b90173 to 127.0.0.1:60277 2023-07-21 10:15:49,333 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(3305): Received CLOSE for 585e96271ab8cbfacaf384e016deea90 2023-07-21 10:15:49,333 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:49,333 DEBUG [RS:1;jenkins-hbase17:42413] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25534e74 to 127.0.0.1:60277 2023-07-21 10:15:49,333 DEBUG [RS:1;jenkins-hbase17:42413] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:49,333 DEBUG [RS:2;jenkins-hbase17:38115] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:49,334 INFO [RS:0;jenkins-hbase17:35819] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 10:15:49,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 585e96271ab8cbfacaf384e016deea90, disabling compactions & flushes 2023-07-21 10:15:49,334 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 10:15:49,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:15:49,334 INFO [RS:0;jenkins-hbase17:35819] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 10:15:49,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing a39a9244d3af3210798aa1f983e4d937, disabling compactions & flushes 2023-07-21 10:15:49,335 INFO [RS:0;jenkins-hbase17:35819] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 10:15:49,335 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 10:15:49,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:15:49,335 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-21 10:15:49,334 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1478): Online Regions={585e96271ab8cbfacaf384e016deea90=hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90.} 2023-07-21 10:15:49,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. after waiting 0 ms 2023-07-21 10:15:49,335 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1478): Online Regions={a39a9244d3af3210798aa1f983e4d937=hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937.} 2023-07-21 10:15:49,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:15:49,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:15:49,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:15:49,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 585e96271ab8cbfacaf384e016deea90 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-21 10:15:49,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. after waiting 0 ms 2023-07-21 10:15:49,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:15:49,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing a39a9244d3af3210798aa1f983e4d937 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-21 10:15:49,336 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 10:15:49,336 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-21 10:15:49,336 DEBUG [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1504): Waiting on a39a9244d3af3210798aa1f983e4d937 2023-07-21 10:15:49,336 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-21 10:15:49,336 DEBUG [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1504): Waiting on 585e96271ab8cbfacaf384e016deea90 2023-07-21 10:15:49,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 10:15:49,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 10:15:49,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 10:15:49,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 10:15:49,337 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 10:15:49,337 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-07-21 10:15:49,348 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:49,373 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:49,377 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-21 10:15:49,380 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-21 10:15:49,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90/.tmp/info/705e41c729e14a55906f67202dac6a63 2023-07-21 10:15:49,386 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937/.tmp/l/fbe3123bb1914793a73b4eadc73c619d 2023-07-21 10:15:49,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/.tmp/info/a10abba1e95846a89885dffb10597859 2023-07-21 10:15:49,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbe3123bb1914793a73b4eadc73c619d 2023-07-21 10:15:49,401 INFO [regionserver/jenkins-hbase17:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:49,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90/.tmp/info/705e41c729e14a55906f67202dac6a63 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90/info/705e41c729e14a55906f67202dac6a63 2023-07-21 10:15:49,405 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a10abba1e95846a89885dffb10597859 2023-07-21 10:15:49,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937/.tmp/l/fbe3123bb1914793a73b4eadc73c619d as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937/l/fbe3123bb1914793a73b4eadc73c619d 2023-07-21 10:15:49,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90/info/705e41c729e14a55906f67202dac6a63, entries=2, sequenceid=6, filesize=4.8 K 2023-07-21 10:15:49,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbe3123bb1914793a73b4eadc73c619d 2023-07-21 10:15:49,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937/l/fbe3123bb1914793a73b4eadc73c619d, entries=7, sequenceid=18, filesize=5.2 K 2023-07-21 10:15:49,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 585e96271ab8cbfacaf384e016deea90 in 85ms, sequenceid=6, compaction requested=false 2023-07-21 10:15:49,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for a39a9244d3af3210798aa1f983e4d937 in 85ms, sequenceid=18, compaction requested=false 2023-07-21 10:15:49,433 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-21 10:15:49,433 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-21 10:15:49,436 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/.tmp/rep_barrier/2eda21f0a2ca4f2091927a1c54a788b7 2023-07-21 10:15:49,468 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2eda21f0a2ca4f2091927a1c54a788b7 2023-07-21 10:15:49,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/acl/a39a9244d3af3210798aa1f983e4d937/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-21 10:15:49,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:49,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:15:49,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for a39a9244d3af3210798aa1f983e4d937: 2023-07-21 10:15:49,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689934334057.a39a9244d3af3210798aa1f983e4d937. 2023-07-21 10:15:49,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/namespace/585e96271ab8cbfacaf384e016deea90/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 10:15:49,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:49,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:15:49,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 585e96271ab8cbfacaf384e016deea90: 2023-07-21 10:15:49,479 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-21 10:15:49,479 INFO [regionserver/jenkins-hbase17:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-21 10:15:49,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689934332895.585e96271ab8cbfacaf384e016deea90. 2023-07-21 10:15:49,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/.tmp/table/a1a44817018b4937b944188defe62c07 2023-07-21 10:15:49,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1a44817018b4937b944188defe62c07 2023-07-21 10:15:49,515 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/.tmp/info/a10abba1e95846a89885dffb10597859 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/info/a10abba1e95846a89885dffb10597859 2023-07-21 10:15:49,519 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a10abba1e95846a89885dffb10597859 2023-07-21 10:15:49,520 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/info/a10abba1e95846a89885dffb10597859, entries=48, sequenceid=131, filesize=10.3 K 2023-07-21 10:15:49,520 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/.tmp/rep_barrier/2eda21f0a2ca4f2091927a1c54a788b7 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/rep_barrier/2eda21f0a2ca4f2091927a1c54a788b7 2023-07-21 10:15:49,527 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2eda21f0a2ca4f2091927a1c54a788b7 2023-07-21 10:15:49,527 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/rep_barrier/2eda21f0a2ca4f2091927a1c54a788b7, entries=13, sequenceid=131, filesize=6.4 K 2023-07-21 10:15:49,528 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/.tmp/table/a1a44817018b4937b944188defe62c07 as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/table/a1a44817018b4937b944188defe62c07 2023-07-21 10:15:49,536 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,38115,1689934328849; all regions closed. 2023-07-21 10:15:49,536 DEBUG [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-21 10:15:49,537 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,42413,1689934328803; all regions closed. 2023-07-21 10:15:49,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a1a44817018b4937b944188defe62c07 2023-07-21 10:15:49,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/table/a1a44817018b4937b944188defe62c07, entries=24, sequenceid=131, filesize=6.9 K 2023-07-21 10:15:49,551 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 212ms, sequenceid=131, compaction requested=false 2023-07-21 10:15:49,576 DEBUG [RS:1;jenkins-hbase17:42413] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/oldWALs 2023-07-21 10:15:49,576 INFO [RS:1;jenkins-hbase17:42413] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C42413%2C1689934328803:(num 1689934331692) 2023-07-21 10:15:49,576 DEBUG [RS:1;jenkins-hbase17:42413] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:49,576 INFO [RS:1;jenkins-hbase17:42413] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:49,577 DEBUG [RS:2;jenkins-hbase17:38115] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/oldWALs 2023-07-21 10:15:49,577 INFO [RS:2;jenkins-hbase17:38115] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C38115%2C1689934328849:(num 1689934331702) 2023-07-21 10:15:49,577 DEBUG [RS:2;jenkins-hbase17:38115] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:49,577 INFO [RS:2;jenkins-hbase17:38115] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:49,580 INFO [RS:1;jenkins-hbase17:42413] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 10:15:49,581 INFO [RS:1;jenkins-hbase17:42413] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 10:15:49,581 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 10:15:49,581 INFO [RS:2;jenkins-hbase17:38115] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 10:15:49,581 INFO [RS:1;jenkins-hbase17:42413] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 10:15:49,582 INFO [RS:1;jenkins-hbase17:42413] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 10:15:49,584 INFO [RS:2;jenkins-hbase17:38115] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 10:15:49,584 INFO [RS:2;jenkins-hbase17:38115] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 10:15:49,584 INFO [RS:2;jenkins-hbase17:38115] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 10:15:49,584 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 10:15:49,584 INFO [RS:1;jenkins-hbase17:42413] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:42413 2023-07-21 10:15:49,589 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-21 10:15:49,589 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 10:15:49,589 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 10:15:49,591 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:49,591 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:49,591 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:49,591 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:49,591 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:49,591 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,42413,1689934328803 2023-07-21 10:15:49,591 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:49,593 INFO [RS:2;jenkins-hbase17:38115] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:38115 2023-07-21 10:15:49,595 INFO [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 10:15:49,595 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 10:15:49,595 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase17:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-21 10:15:49,596 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,42413,1689934328803] 2023-07-21 10:15:49,597 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,42413,1689934328803; numProcessing=1 2023-07-21 10:15:49,693 INFO [RS:1;jenkins-hbase17:42413] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,42413,1689934328803; zookeeper connection closed. 2023-07-21 10:15:49,693 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:49,693 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:42413-0x101875ce56c0002, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:49,693 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2462d7cd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2462d7cd 2023-07-21 10:15:49,693 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:49,693 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,38115,1689934328849 2023-07-21 10:15:49,693 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:49,693 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,42413,1689934328803 already deleted, retry=false 2023-07-21 10:15:49,693 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,42413,1689934328803 expired; onlineServers=2 2023-07-21 10:15:49,694 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,38115,1689934328849] 2023-07-21 10:15:49,694 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,38115,1689934328849; numProcessing=2 2023-07-21 10:15:49,695 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,38115,1689934328849 already deleted, retry=false 2023-07-21 10:15:49,695 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,38115,1689934328849 expired; onlineServers=1 2023-07-21 10:15:49,736 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,35819,1689934328736; all regions closed. 2023-07-21 10:15:49,746 DEBUG [RS:0;jenkins-hbase17:35819] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/oldWALs 2023-07-21 10:15:49,746 INFO [RS:0;jenkins-hbase17:35819] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C35819%2C1689934328736.meta:.meta(num 1689934332179) 2023-07-21 10:15:49,760 DEBUG [RS:0;jenkins-hbase17:35819] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/oldWALs 2023-07-21 10:15:49,760 INFO [RS:0;jenkins-hbase17:35819] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase17.apache.org%2C35819%2C1689934328736:(num 1689934331692) 2023-07-21 10:15:49,760 DEBUG [RS:0;jenkins-hbase17:35819] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:49,760 INFO [RS:0;jenkins-hbase17:35819] regionserver.LeaseManager(133): Closed leases 2023-07-21 10:15:49,762 INFO [RS:0;jenkins-hbase17:35819] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase17:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 10:15:49,762 INFO [regionserver/jenkins-hbase17:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 10:15:49,773 INFO [RS:0;jenkins-hbase17:35819] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:35819 2023-07-21 10:15:49,781 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 10:15:49,781 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase17.apache.org,35819,1689934328736 2023-07-21 10:15:49,781 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase17.apache.org,35819,1689934328736] 2023-07-21 10:15:49,781 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase17.apache.org,35819,1689934328736; numProcessing=3 2023-07-21 10:15:49,788 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase17.apache.org,35819,1689934328736 already deleted, retry=false 2023-07-21 10:15:49,788 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase17.apache.org,35819,1689934328736 expired; onlineServers=0 2023-07-21 10:15:49,788 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase17.apache.org,38671,1689934327089' ***** 2023-07-21 10:15:49,789 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-21 10:15:49,789 DEBUG [M:0;jenkins-hbase17:38671] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c143ef7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase17.apache.org/136.243.18.41:0 2023-07-21 10:15:49,789 INFO [M:0;jenkins-hbase17:38671] regionserver.HRegionServer(1144): stopping server jenkins-hbase17.apache.org,38671,1689934327089 2023-07-21 10:15:49,789 INFO [M:0;jenkins-hbase17:38671] regionserver.HRegionServer(1170): stopping server jenkins-hbase17.apache.org,38671,1689934327089; all regions closed. 2023-07-21 10:15:49,789 DEBUG [M:0;jenkins-hbase17:38671] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 10:15:49,789 DEBUG [M:0;jenkins-hbase17:38671] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-21 10:15:49,789 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-21 10:15:49,789 DEBUG [M:0;jenkins-hbase17:38671] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-21 10:15:49,789 INFO [M:0;jenkins-hbase17:38671] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-21 10:15:49,789 INFO [M:0;jenkins-hbase17:38671] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-21 10:15:49,790 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689934330876] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.small.0-1689934330876,5,FailOnTimeoutGroup] 2023-07-21 10:15:49,790 INFO [M:0;jenkins-hbase17:38671] hbase.ChoreService(369): Chore service for: master/jenkins-hbase17:0 had [] on shutdown 2023-07-21 10:15:49,790 DEBUG [M:0;jenkins-hbase17:38671] master.HMaster(1512): Stopping service threads 2023-07-21 10:15:49,790 INFO [M:0;jenkins-hbase17:38671] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-21 10:15:49,790 ERROR [M:0;jenkins-hbase17:38671] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-27,5,PEWorkerGroup] Thread[HFileArchiver-28,5,PEWorkerGroup] 2023-07-21 10:15:49,791 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-21 10:15:49,791 INFO [M:0;jenkins-hbase17:38671] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-21 10:15:49,791 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 10:15:49,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 10:15:49,791 DEBUG [M:0;jenkins-hbase17:38671] zookeeper.ZKUtil(398): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-21 10:15:49,792 WARN [M:0;jenkins-hbase17:38671] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-21 10:15:49,792 INFO [M:0;jenkins-hbase17:38671] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-21 10:15:49,792 INFO [M:0;jenkins-hbase17:38671] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-21 10:15:49,793 DEBUG [M:0;jenkins-hbase17:38671] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 10:15:49,793 INFO [M:0;jenkins-hbase17:38671] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:15:49,793 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-21 10:15:49,793 DEBUG [M:0;jenkins-hbase17:38671] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:15:49,793 DEBUG [M:0;jenkins-hbase17:38671] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 10:15:49,793 DEBUG [master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689934330875] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase17:0:becomeActiveMaster-HFileCleaner.large.0-1689934330875,5,FailOnTimeoutGroup] 2023-07-21 10:15:49,793 DEBUG [M:0;jenkins-hbase17:38671] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:15:49,793 INFO [M:0;jenkins-hbase17:38671] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.77 KB heapSize=449.96 KB 2023-07-21 10:15:49,794 INFO [RS:2;jenkins-hbase17:38115] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,38115,1689934328849; zookeeper connection closed. 2023-07-21 10:15:49,794 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:49,794 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:38115-0x101875ce56c0003, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:49,795 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@8b7f141] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@8b7f141 2023-07-21 10:15:49,895 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:49,895 INFO [RS:0;jenkins-hbase17:35819] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,35819,1689934328736; zookeeper connection closed. 2023-07-21 10:15:49,895 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): regionserver:35819-0x101875ce56c0001, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:49,895 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3c1b2302] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3c1b2302 2023-07-21 10:15:49,895 INFO [Listener at jenkins-hbase17.apache.org/33881] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-21 10:15:50,240 INFO [M:0;jenkins-hbase17:38671] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.77 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/494df455884d4c73b842151153e91a2f 2023-07-21 10:15:50,244 INFO [M:0;jenkins-hbase17:38671] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 494df455884d4c73b842151153e91a2f 2023-07-21 10:15:50,245 DEBUG [M:0;jenkins-hbase17:38671] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/494df455884d4c73b842151153e91a2f as hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/494df455884d4c73b842151153e91a2f 2023-07-21 10:15:50,250 INFO [M:0;jenkins-hbase17:38671] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 494df455884d4c73b842151153e91a2f 2023-07-21 10:15:50,251 INFO [M:0;jenkins-hbase17:38671] regionserver.HStore(1080): Added hdfs://localhost.localdomain:46589/user/jenkins/test-data/ce59211d-e610-5330-1196-85145333bb5a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/494df455884d4c73b842151153e91a2f, entries=119, sequenceid=899, filesize=28.4 K 2023-07-21 10:15:50,251 INFO [M:0;jenkins-hbase17:38671] regionserver.HRegion(2948): Finished flush of dataSize ~373.77 KB/382736, heapSize ~449.95 KB/460744, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 458ms, sequenceid=899, compaction requested=false 2023-07-21 10:15:50,253 INFO [M:0;jenkins-hbase17:38671] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 10:15:50,253 DEBUG [M:0;jenkins-hbase17:38671] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 10:15:50,257 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 10:15:50,257 INFO [M:0;jenkins-hbase17:38671] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-21 10:15:50,257 INFO [M:0;jenkins-hbase17:38671] ipc.NettyRpcServer(158): Stopping server on /136.243.18.41:38671 2023-07-21 10:15:50,258 DEBUG [M:0;jenkins-hbase17:38671] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase17.apache.org,38671,1689934327089 already deleted, retry=false 2023-07-21 10:15:50,359 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:50,359 INFO [M:0;jenkins-hbase17:38671] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase17.apache.org,38671,1689934327089; zookeeper connection closed. 2023-07-21 10:15:50,359 DEBUG [Listener at localhost.localdomain/36149-EventThread] zookeeper.ZKWatcher(600): master:38671-0x101875ce56c0000, quorum=127.0.0.1:60277, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 10:15:50,361 WARN [Listener at jenkins-hbase17.apache.org/33881] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 10:15:50,375 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 10:15:50,379 WARN [BP-1190640672-136.243.18.41-1689934321960 heartbeating to localhost.localdomain/127.0.0.1:46589] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 10:15:50,379 WARN [BP-1190640672-136.243.18.41-1689934321960 heartbeating to localhost.localdomain/127.0.0.1:46589] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1190640672-136.243.18.41-1689934321960 (Datanode Uuid a7008744-80b7-4b09-a2ff-066906b34500) service to localhost.localdomain/127.0.0.1:46589 2023-07-21 10:15:50,380 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data5/current/BP-1190640672-136.243.18.41-1689934321960] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:50,381 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data6/current/BP-1190640672-136.243.18.41-1689934321960] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:50,383 WARN [Listener at jenkins-hbase17.apache.org/33881] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 10:15:50,390 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 10:15:50,494 WARN [BP-1190640672-136.243.18.41-1689934321960 heartbeating to localhost.localdomain/127.0.0.1:46589] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 10:15:50,494 WARN [BP-1190640672-136.243.18.41-1689934321960 heartbeating to localhost.localdomain/127.0.0.1:46589] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1190640672-136.243.18.41-1689934321960 (Datanode Uuid c12952fd-8e7b-4b19-aa65-fbaadedd8c63) service to localhost.localdomain/127.0.0.1:46589 2023-07-21 10:15:50,496 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data3/current/BP-1190640672-136.243.18.41-1689934321960] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:50,496 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data4/current/BP-1190640672-136.243.18.41-1689934321960] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:50,498 WARN [Listener at jenkins-hbase17.apache.org/33881] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 10:15:50,505 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 10:15:50,609 WARN [BP-1190640672-136.243.18.41-1689934321960 heartbeating to localhost.localdomain/127.0.0.1:46589] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 10:15:50,609 WARN [BP-1190640672-136.243.18.41-1689934321960 heartbeating to localhost.localdomain/127.0.0.1:46589] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1190640672-136.243.18.41-1689934321960 (Datanode Uuid f8329972-a431-4fbb-a07c-8bb37c7d6417) service to localhost.localdomain/127.0.0.1:46589 2023-07-21 10:15:50,610 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data1/current/BP-1190640672-136.243.18.41-1689934321960] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:50,649 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/958037c4-5246-26d4-ef60-b82027368763/cluster_bd967a0e-cdf9-ae1e-085f-b654acecd998/dfs/data/data2/current/BP-1190640672-136.243.18.41-1689934321960] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 10:15:50,679 INFO [Listener at jenkins-hbase17.apache.org/33881] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-07-21 10:15:50,816 INFO [Listener at jenkins-hbase17.apache.org/33881] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-21 10:15:50,907 INFO [Listener at jenkins-hbase17.apache.org/33881] hbase.HBaseTestingUtility(1293): Minicluster is down