2023-09-28 02:00:59,204 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-28 02:00:59,411 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e 2023-09-28 02:00:59,411 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-28 02:00:59,411 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-28 02:00:59,451 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-28 02:00:59,722 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-28 02:00:59,723 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198, deleteOnExit=true 2023-09-28 02:00:59,723 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-28 02:00:59,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/test.cache.data in system properties and HBase conf 2023-09-28 02:00:59,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop.tmp.dir in system properties and HBase conf 2023-09-28 02:00:59,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop.log.dir in system properties and HBase conf 2023-09-28 02:00:59,725 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-28 02:00:59,726 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-28 02:00:59,726 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-28 02:01:00,053 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-28 02:01:00,058 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-28 02:01:00,059 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-28 02:01:00,059 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-28 02:01:00,059 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 02:01:00,059 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-28 02:01:00,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-28 02:01:00,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 02:01:00,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 02:01:00,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-28 02:01:00,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/nfs.dump.dir in system properties and HBase conf 2023-09-28 02:01:00,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir in system properties and HBase conf 2023-09-28 02:01:00,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 02:01:00,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-28 02:01:00,062 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-28 02:01:00,559 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-28 02:01:00,564 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-28 02:01:00,872 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-28 02:01:01,055 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-28 02:01:01,069 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 02:01:01,119 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 02:01:01,154 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir/Jetty_localhost_40783_hdfs____4z2ja8/webapp 2023-09-28 02:01:01,310 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40783 2023-09-28 02:01:01,359 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-28 02:01:01,360 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-28 02:01:01,902 WARN [Listener at localhost/35003] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 02:01:01,974 WARN [Listener at localhost/35003] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 02:01:01,994 WARN [Listener at localhost/35003] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 02:01:02,002 INFO [Listener at localhost/35003] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 02:01:02,008 INFO [Listener at localhost/35003] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir/Jetty_localhost_33359_datanode____ps2cke/webapp 2023-09-28 02:01:02,142 INFO [Listener at localhost/35003] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33359 2023-09-28 02:01:02,578 WARN [Listener at localhost/45885] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 02:01:02,592 WARN [Listener at localhost/45885] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 02:01:02,596 WARN [Listener at localhost/45885] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 02:01:02,598 INFO [Listener at localhost/45885] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 02:01:02,609 INFO [Listener at localhost/45885] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir/Jetty_localhost_33311_datanode____r0eye2/webapp 2023-09-28 02:01:02,744 INFO [Listener at localhost/45885] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33311 2023-09-28 02:01:02,755 WARN [Listener at localhost/45479] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 02:01:02,787 WARN [Listener at localhost/45479] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-28 02:01:02,792 WARN [Listener at localhost/45479] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 02:01:02,794 INFO [Listener at localhost/45479] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 02:01:02,806 INFO [Listener at localhost/45479] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir/Jetty_localhost_34133_datanode____db3bcn/webapp 2023-09-28 02:01:02,935 INFO [Listener at localhost/45479] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34133 2023-09-28 02:01:02,950 WARN [Listener at localhost/36725] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-28 02:01:03,250 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed67a9e06f14e7af: Processing first storage report for DS-35bba228-6e8b-479f-b553-c69a96d937b3 from datanode 2792056d-c488-441c-a5fa-5fb161447518 2023-09-28 02:01:03,252 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed67a9e06f14e7af: from storage DS-35bba228-6e8b-479f-b553-c69a96d937b3 node DatanodeRegistration(127.0.0.1:43693, datanodeUuid=2792056d-c488-441c-a5fa-5fb161447518, infoPort=42019, infoSecurePort=0, ipcPort=45479, storageInfo=lv=-57;cid=testClusterID;nsid=187776523;c=1695866460646), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-28 02:01:03,253 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3278c42a81a10a7: Processing first storage report for DS-3417f538-4784-4f70-a58d-f97c0f5b2d71 from datanode 3b8c3915-3094-4d3c-84e3-770e2527949b 2023-09-28 02:01:03,253 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3278c42a81a10a7: from storage DS-3417f538-4784-4f70-a58d-f97c0f5b2d71 node DatanodeRegistration(127.0.0.1:45411, datanodeUuid=3b8c3915-3094-4d3c-84e3-770e2527949b, infoPort=43639, infoSecurePort=0, ipcPort=36725, storageInfo=lv=-57;cid=testClusterID;nsid=187776523;c=1695866460646), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 02:01:03,253 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0df111c5b78781f: Processing first storage report for DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72 from datanode a40d966c-8083-4c10-a3e3-0fee32a5c6ac 2023-09-28 02:01:03,254 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0df111c5b78781f: from storage DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72 node DatanodeRegistration(127.0.0.1:40073, datanodeUuid=a40d966c-8083-4c10-a3e3-0fee32a5c6ac, infoPort=39597, infoSecurePort=0, ipcPort=45885, storageInfo=lv=-57;cid=testClusterID;nsid=187776523;c=1695866460646), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-28 02:01:03,254 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed67a9e06f14e7af: Processing first storage report for DS-7ce1a156-5558-4e04-9355-c7d0609d230a from datanode 2792056d-c488-441c-a5fa-5fb161447518 2023-09-28 02:01:03,254 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed67a9e06f14e7af: from storage DS-7ce1a156-5558-4e04-9355-c7d0609d230a node DatanodeRegistration(127.0.0.1:43693, datanodeUuid=2792056d-c488-441c-a5fa-5fb161447518, infoPort=42019, infoSecurePort=0, ipcPort=45479, storageInfo=lv=-57;cid=testClusterID;nsid=187776523;c=1695866460646), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 02:01:03,254 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3278c42a81a10a7: Processing first storage report for DS-a446dd0a-800e-4ba7-b3a9-9fdf694ee294 from datanode 3b8c3915-3094-4d3c-84e3-770e2527949b 2023-09-28 02:01:03,255 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3278c42a81a10a7: from storage DS-a446dd0a-800e-4ba7-b3a9-9fdf694ee294 node DatanodeRegistration(127.0.0.1:45411, datanodeUuid=3b8c3915-3094-4d3c-84e3-770e2527949b, infoPort=43639, infoSecurePort=0, ipcPort=36725, storageInfo=lv=-57;cid=testClusterID;nsid=187776523;c=1695866460646), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 02:01:03,255 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd0df111c5b78781f: Processing first storage report for DS-75300a4c-fbfe-4a9d-8f82-d9d03223164e from datanode a40d966c-8083-4c10-a3e3-0fee32a5c6ac 2023-09-28 02:01:03,255 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd0df111c5b78781f: from storage DS-75300a4c-fbfe-4a9d-8f82-d9d03223164e node DatanodeRegistration(127.0.0.1:40073, datanodeUuid=a40d966c-8083-4c10-a3e3-0fee32a5c6ac, infoPort=39597, infoSecurePort=0, ipcPort=45885, storageInfo=lv=-57;cid=testClusterID;nsid=187776523;c=1695866460646), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-28 02:01:03,516 DEBUG [Listener at localhost/36725] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e 2023-09-28 02:01:03,605 INFO [Listener at localhost/36725] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/zookeeper_0, clientPort=56493, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-28 02:01:03,625 INFO [Listener at localhost/36725] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56493 2023-09-28 02:01:03,633 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:03,635 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:04,336 INFO [Listener at localhost/36725] util.FSUtils(471): Created version file at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d with version=8 2023-09-28 02:01:04,337 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/hbase-staging 2023-09-28 02:01:04,694 INFO [Listener at localhost/36725] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-28 02:01:05,169 INFO [Listener at localhost/36725] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 02:01:05,203 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,204 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,204 INFO [Listener at localhost/36725] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 02:01:05,204 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,204 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 02:01:05,363 INFO [Listener at localhost/36725] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 02:01:05,437 DEBUG [Listener at localhost/36725] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-28 02:01:05,531 INFO [Listener at localhost/36725] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44049 2023-09-28 02:01:05,544 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:05,546 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:05,570 INFO [Listener at localhost/36725] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44049 connecting to ZooKeeper ensemble=127.0.0.1:56493 2023-09-28 02:01:05,628 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:440490x0, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 02:01:05,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44049-0x100f043dd070000 connected 2023-09-28 02:01:05,660 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 02:01:05,661 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 02:01:05,674 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 02:01:05,682 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44049 2023-09-28 02:01:05,683 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44049 2023-09-28 02:01:05,683 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44049 2023-09-28 02:01:05,684 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44049 2023-09-28 02:01:05,684 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44049 2023-09-28 02:01:05,690 INFO [Listener at localhost/36725] master.HMaster(444): hbase.rootdir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d, hbase.cluster.distributed=false 2023-09-28 02:01:05,755 INFO [Listener at localhost/36725] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 02:01:05,755 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,755 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,756 INFO [Listener at localhost/36725] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 02:01:05,756 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,756 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 02:01:05,761 INFO [Listener at localhost/36725] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 02:01:05,764 INFO [Listener at localhost/36725] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41721 2023-09-28 02:01:05,767 INFO [Listener at localhost/36725] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 02:01:05,781 INFO [Listener at localhost/36725] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 02:01:05,783 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:05,786 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:05,788 INFO [Listener at localhost/36725] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41721 connecting to ZooKeeper ensemble=127.0.0.1:56493 2023-09-28 02:01:05,793 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:417210x0, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 02:01:05,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41721-0x100f043dd070001 connected 2023-09-28 02:01:05,794 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 02:01:05,795 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 02:01:05,797 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 02:01:05,797 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41721 2023-09-28 02:01:05,798 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41721 2023-09-28 02:01:05,798 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41721 2023-09-28 02:01:05,799 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41721 2023-09-28 02:01:05,800 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41721 2023-09-28 02:01:05,813 INFO [Listener at localhost/36725] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 02:01:05,813 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,813 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,814 INFO [Listener at localhost/36725] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 02:01:05,814 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,814 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 02:01:05,814 INFO [Listener at localhost/36725] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 02:01:05,816 INFO [Listener at localhost/36725] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42313 2023-09-28 02:01:05,817 INFO [Listener at localhost/36725] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 02:01:05,818 INFO [Listener at localhost/36725] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 02:01:05,819 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:05,821 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:05,824 INFO [Listener at localhost/36725] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42313 connecting to ZooKeeper ensemble=127.0.0.1:56493 2023-09-28 02:01:05,828 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:423130x0, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 02:01:05,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42313-0x100f043dd070002 connected 2023-09-28 02:01:05,830 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 02:01:05,830 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 02:01:05,831 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 02:01:05,832 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42313 2023-09-28 02:01:05,832 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42313 2023-09-28 02:01:05,833 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42313 2023-09-28 02:01:05,837 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42313 2023-09-28 02:01:05,837 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42313 2023-09-28 02:01:05,850 INFO [Listener at localhost/36725] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-28 02:01:05,850 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,850 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,850 INFO [Listener at localhost/36725] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-28 02:01:05,850 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-28 02:01:05,851 INFO [Listener at localhost/36725] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-28 02:01:05,851 INFO [Listener at localhost/36725] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-28 02:01:05,853 INFO [Listener at localhost/36725] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46883 2023-09-28 02:01:05,853 INFO [Listener at localhost/36725] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-28 02:01:05,854 INFO [Listener at localhost/36725] mob.MobFileCache(125): MobFileCache disabled 2023-09-28 02:01:05,855 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:05,858 INFO [Listener at localhost/36725] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:05,861 INFO [Listener at localhost/36725] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46883 connecting to ZooKeeper ensemble=127.0.0.1:56493 2023-09-28 02:01:05,865 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:468830x0, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-28 02:01:05,866 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): regionserver:468830x0, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 02:01:05,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46883-0x100f043dd070003 connected 2023-09-28 02:01:05,867 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 02:01:05,868 DEBUG [Listener at localhost/36725] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-28 02:01:05,869 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46883 2023-09-28 02:01:05,869 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46883 2023-09-28 02:01:05,873 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46883 2023-09-28 02:01:05,874 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46883 2023-09-28 02:01:05,876 DEBUG [Listener at localhost/36725] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46883 2023-09-28 02:01:05,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:01:05,887 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-28 02:01:05,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:01:05,907 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 02:01:05,907 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 02:01:05,907 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 02:01:05,907 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-28 02:01:05,909 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:01:05,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-28 02:01:05,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44049,1695866464521 from backup master directory 2023-09-28 02:01:05,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-28 02:01:05,918 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:01:05,918 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-28 02:01:05,919 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 02:01:05,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:01:05,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-28 02:01:05,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-28 02:01:06,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/hbase.id with ID: 78916fcf-7c6f-4724-bf08-3bd2e8e67a56 2023-09-28 02:01:06,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-28 02:01:06,084 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:01:06,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0134430f to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:06,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dde2651, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:06,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-28 02:01:06,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-28 02:01:06,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-28 02:01:06,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-28 02:01:06,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-28 02:01:06,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-28 02:01:06,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 02:01:06,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/data/master/store-tmp 2023-09-28 02:01:06,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:06,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-28 02:01:06,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 02:01:06,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 02:01:06,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-28 02:01:06,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 02:01:06,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 02:01:06,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 02:01:06,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/WALs/jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:01:06,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44049%2C1695866464521, suffix=, logDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/WALs/jenkins-hbase4.apache.org,44049,1695866464521, archiveDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/oldWALs, maxLogs=10 2023-09-28 02:01:06,394 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK] 2023-09-28 02:01:06,394 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK] 2023-09-28 02:01:06,394 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK] 2023-09-28 02:01:06,405 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-28 02:01:06,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/WALs/jenkins-hbase4.apache.org,44049,1695866464521/jenkins-hbase4.apache.org%2C44049%2C1695866464521.1695866466344 2023-09-28 02:01:06,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK], DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK], DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK]] 2023-09-28 02:01:06,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-28 02:01:06,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:06,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 02:01:06,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 02:01:06,544 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-28 02:01:06,551 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-28 02:01:06,586 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-28 02:01:06,599 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:06,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-28 02:01:06,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-28 02:01:06,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-28 02:01:06,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:06,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74535929, jitterRate=0.11067189276218414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:01:06,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 02:01:06,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-28 02:01:06,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-28 02:01:06,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-28 02:01:06,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-28 02:01:06,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-28 02:01:06,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 37 msec 2023-09-28 02:01:06,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-28 02:01:06,733 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-28 02:01:06,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-28 02:01:06,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-28 02:01:06,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-28 02:01:06,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-28 02:01:06,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.SimpleRegionNormalizer(156): Updated configuration for key 'hbase.normalizer.merge.merge_request_max_number_of_regions' from 100 to 50 2023-09-28 02:01:06,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-28 02:01:06,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-28 02:01:06,805 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:01:06,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-28 02:01:06,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-28 02:01:06,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-28 02:01:06,834 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 02:01:06,834 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 02:01:06,834 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 02:01:06,834 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-28 02:01:06,834 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:01:06,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44049,1695866464521, sessionid=0x100f043dd070000, setting cluster-up flag (Was=false) 2023-09-28 02:01:06,858 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:01:06,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-28 02:01:06,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:01:06,872 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:01:06,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-28 02:01:06,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:01:06,884 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp 2023-09-28 02:01:06,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-28 02:01:06,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:06,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-28 02:01:06,980 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(951): ClusterId : 78916fcf-7c6f-4724-bf08-3bd2e8e67a56 2023-09-28 02:01:06,980 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(951): ClusterId : 78916fcf-7c6f-4724-bf08-3bd2e8e67a56 2023-09-28 02:01:06,980 INFO [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(951): ClusterId : 78916fcf-7c6f-4724-bf08-3bd2e8e67a56 2023-09-28 02:01:06,988 DEBUG [RS:2;jenkins-hbase4:46883] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 02:01:06,988 DEBUG [RS:1;jenkins-hbase4:42313] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 02:01:06,988 DEBUG [RS:0;jenkins-hbase4:41721] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-28 02:01:06,996 DEBUG [RS:2;jenkins-hbase4:46883] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 02:01:06,996 DEBUG [RS:1;jenkins-hbase4:42313] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 02:01:06,996 DEBUG [RS:0;jenkins-hbase4:41721] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-28 02:01:06,997 DEBUG [RS:1;jenkins-hbase4:42313] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 02:01:06,997 DEBUG [RS:2;jenkins-hbase4:46883] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 02:01:06,997 DEBUG [RS:0;jenkins-hbase4:41721] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-28 02:01:07,001 DEBUG [RS:1;jenkins-hbase4:42313] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 02:01:07,001 DEBUG [RS:0;jenkins-hbase4:41721] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 02:01:07,001 DEBUG [RS:2;jenkins-hbase4:46883] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-28 02:01:07,005 DEBUG [RS:1;jenkins-hbase4:42313] zookeeper.ReadOnlyZKClient(139): Connect 0x4168517d to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:07,006 DEBUG [RS:0;jenkins-hbase4:41721] zookeeper.ReadOnlyZKClient(139): Connect 0x5c203099 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:07,005 DEBUG [RS:2;jenkins-hbase4:46883] zookeeper.ReadOnlyZKClient(139): Connect 0x37c9bba2 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:07,020 DEBUG [RS:1;jenkins-hbase4:42313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fafb720, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:07,021 DEBUG [RS:1;jenkins-hbase4:42313] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b903a0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 02:01:07,049 DEBUG [RS:0;jenkins-hbase4:41721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52e7c56d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:07,049 DEBUG [RS:2;jenkins-hbase4:46883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@390e432b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:07,049 DEBUG [RS:0;jenkins-hbase4:41721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56d85be9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 02:01:07,050 DEBUG [RS:2;jenkins-hbase4:46883] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78334910, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 02:01:07,069 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:42313 2023-09-28 02:01:07,069 DEBUG [RS:0;jenkins-hbase4:41721] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41721 2023-09-28 02:01:07,073 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:46883 2023-09-28 02:01:07,074 INFO [RS:0;jenkins-hbase4:41721] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 02:01:07,074 INFO [RS:2;jenkins-hbase4:46883] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 02:01:07,075 INFO [RS:0;jenkins-hbase4:41721] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 02:01:07,074 INFO [RS:1;jenkins-hbase4:42313] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-28 02:01:07,075 INFO [RS:2;jenkins-hbase4:46883] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 02:01:07,075 INFO [RS:1;jenkins-hbase4:42313] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-28 02:01:07,075 DEBUG [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 02:01:07,075 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 02:01:07,075 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-28 02:01:07,076 INFO [RS:0;jenkins-hbase4:41721] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:07,076 INFO [RS:1;jenkins-hbase4:42313] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:07,076 INFO [RS:2;jenkins-hbase4:46883] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:07,077 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 02:01:07,076 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 02:01:07,076 DEBUG [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(1022): About to register with Master. 2023-09-28 02:01:07,080 INFO [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44049,1695866464521 with isa=jenkins-hbase4.apache.org/172.31.14.131:41721, startcode=1695866465754 2023-09-28 02:01:07,080 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44049,1695866464521 with isa=jenkins-hbase4.apache.org/172.31.14.131:42313, startcode=1695866465812 2023-09-28 02:01:07,080 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44049,1695866464521 with isa=jenkins-hbase4.apache.org/172.31.14.131:46883, startcode=1695866465849 2023-09-28 02:01:07,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-28 02:01:07,100 DEBUG [RS:0;jenkins-hbase4:41721] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 02:01:07,100 DEBUG [RS:1;jenkins-hbase4:42313] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 02:01:07,100 DEBUG [RS:2;jenkins-hbase4:46883] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-28 02:01:07,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 02:01:07,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 02:01:07,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 02:01:07,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-28 02:01:07,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-28 02:01:07,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 02:01:07,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695866497110 2023-09-28 02:01:07,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-28 02:01:07,116 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-28 02:01:07,117 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-28 02:01:07,121 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 02:01:07,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-28 02:01:07,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-28 02:01:07,134 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-28 02:01:07,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-28 02:01:07,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-28 02:01:07,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-28 02:01:07,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-28 02:01:07,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-28 02:01:07,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-28 02:01:07,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-28 02:01:07,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695866467154,5,FailOnTimeoutGroup] 2023-09-28 02:01:07,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695866467158,5,FailOnTimeoutGroup] 2023-09-28 02:01:07,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-28 02:01:07,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,183 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58781, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 02:01:07,183 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50217, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 02:01:07,183 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46061, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-28 02:01:07,184 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-28 02:01:07,185 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-28 02:01:07,185 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:07,197 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44049] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:07,218 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44049] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:07,219 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44049] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:07,222 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:07,225 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:07,225 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:07,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-28 02:01:07,225 DEBUG [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:07,226 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35003 2023-09-28 02:01:07,226 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35003 2023-09-28 02:01:07,226 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 02:01:07,226 DEBUG [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35003 2023-09-28 02:01:07,226 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 02:01:07,226 DEBUG [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-28 02:01:07,229 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/info 2023-09-28 02:01:07,230 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-28 02:01:07,231 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:07,231 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-28 02:01:07,236 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 02:01:07,237 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/rep_barrier 2023-09-28 02:01:07,237 DEBUG [RS:2;jenkins-hbase4:46883] zookeeper.ZKUtil(162): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:07,237 DEBUG [RS:1;jenkins-hbase4:42313] zookeeper.ZKUtil(162): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:07,237 WARN [RS:2;jenkins-hbase4:46883] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 02:01:07,237 WARN [RS:1;jenkins-hbase4:42313] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 02:01:07,237 DEBUG [RS:0;jenkins-hbase4:41721] zookeeper.ZKUtil(162): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:07,238 INFO [RS:2;jenkins-hbase4:46883] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 02:01:07,238 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-28 02:01:07,238 WARN [RS:0;jenkins-hbase4:41721] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-28 02:01:07,238 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:07,238 INFO [RS:0;jenkins-hbase4:41721] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 02:01:07,238 INFO [RS:1;jenkins-hbase4:42313] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 02:01:07,242 DEBUG [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:07,242 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:07,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:07,245 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-28 02:01:07,248 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46883,1695866465849] 2023-09-28 02:01:07,249 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42313,1695866465812] 2023-09-28 02:01:07,249 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41721,1695866465754] 2023-09-28 02:01:07,254 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/table 2023-09-28 02:01:07,256 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-28 02:01:07,257 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:07,261 DEBUG [RS:2;jenkins-hbase4:46883] zookeeper.ZKUtil(162): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:07,263 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740 2023-09-28 02:01:07,262 DEBUG [RS:0;jenkins-hbase4:41721] zookeeper.ZKUtil(162): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:07,261 DEBUG [RS:1;jenkins-hbase4:42313] zookeeper.ZKUtil(162): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:07,270 DEBUG [RS:2;jenkins-hbase4:46883] zookeeper.ZKUtil(162): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:07,270 DEBUG [RS:0;jenkins-hbase4:41721] zookeeper.ZKUtil(162): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:07,271 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740 2023-09-28 02:01:07,271 DEBUG [RS:1;jenkins-hbase4:42313] zookeeper.ZKUtil(162): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:07,271 DEBUG [RS:0;jenkins-hbase4:41721] zookeeper.ZKUtil(162): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:07,273 DEBUG [RS:1;jenkins-hbase4:42313] zookeeper.ZKUtil(162): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:07,276 DEBUG [RS:2;jenkins-hbase4:46883] zookeeper.ZKUtil(162): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:07,276 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-28 02:01:07,279 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-28 02:01:07,286 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:07,287 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 02:01:07,287 DEBUG [RS:0;jenkins-hbase4:41721] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 02:01:07,287 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-28 02:01:07,288 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73202667, jitterRate=0.09080474078655243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-28 02:01:07,288 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-28 02:01:07,289 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-28 02:01:07,289 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-28 02:01:07,289 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-28 02:01:07,289 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-28 02:01:07,289 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-28 02:01:07,294 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-28 02:01:07,294 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-28 02:01:07,302 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-28 02:01:07,302 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-28 02:01:07,303 INFO [RS:1;jenkins-hbase4:42313] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 02:01:07,304 INFO [RS:0;jenkins-hbase4:41721] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 02:01:07,303 INFO [RS:2;jenkins-hbase4:46883] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-28 02:01:07,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-28 02:01:07,332 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-28 02:01:07,335 INFO [RS:2;jenkins-hbase4:46883] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 02:01:07,336 INFO [RS:0;jenkins-hbase4:41721] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 02:01:07,335 INFO [RS:1;jenkins-hbase4:42313] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-28 02:01:07,336 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-28 02:01:07,341 INFO [RS:0;jenkins-hbase4:41721] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 02:01:07,341 INFO [RS:2;jenkins-hbase4:46883] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 02:01:07,341 INFO [RS:0;jenkins-hbase4:41721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,341 INFO [RS:1;jenkins-hbase4:42313] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-28 02:01:07,342 INFO [RS:2;jenkins-hbase4:46883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,342 INFO [RS:1;jenkins-hbase4:42313] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,342 INFO [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 02:01:07,342 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 02:01:07,343 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-28 02:01:07,353 INFO [RS:0;jenkins-hbase4:41721] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,353 INFO [RS:2;jenkins-hbase4:46883] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,353 INFO [RS:1;jenkins-hbase4:42313] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,353 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,353 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,353 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,353 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 02:01:07,354 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 02:01:07,354 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,354 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,355 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,355 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,355 DEBUG [RS:1;jenkins-hbase4:42313] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,355 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,355 DEBUG [RS:0;jenkins-hbase4:41721] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,355 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,355 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-28 02:01:07,355 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,355 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,356 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,356 DEBUG [RS:2;jenkins-hbase4:46883] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-28 02:01:07,361 INFO [RS:0;jenkins-hbase4:41721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,361 INFO [RS:1;jenkins-hbase4:42313] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,361 INFO [RS:2;jenkins-hbase4:46883] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,361 INFO [RS:0;jenkins-hbase4:41721] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,361 INFO [RS:2;jenkins-hbase4:46883] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,361 INFO [RS:1;jenkins-hbase4:42313] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,361 INFO [RS:2;jenkins-hbase4:46883] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,361 INFO [RS:0;jenkins-hbase4:41721] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,361 INFO [RS:1;jenkins-hbase4:42313] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,381 INFO [RS:1;jenkins-hbase4:42313] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 02:01:07,381 INFO [RS:0;jenkins-hbase4:41721] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 02:01:07,381 INFO [RS:2;jenkins-hbase4:46883] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-28 02:01:07,386 INFO [RS:1;jenkins-hbase4:42313] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42313,1695866465812-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,386 INFO [RS:0;jenkins-hbase4:41721] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41721,1695866465754-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,386 INFO [RS:2;jenkins-hbase4:46883] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46883,1695866465849-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:07,409 INFO [RS:1;jenkins-hbase4:42313] regionserver.Replication(203): jenkins-hbase4.apache.org,42313,1695866465812 started 2023-09-28 02:01:07,409 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42313,1695866465812, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42313, sessionid=0x100f043dd070002 2023-09-28 02:01:07,409 DEBUG [RS:1;jenkins-hbase4:42313] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 02:01:07,409 DEBUG [RS:1;jenkins-hbase4:42313] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:07,409 DEBUG [RS:1;jenkins-hbase4:42313] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42313,1695866465812' 2023-09-28 02:01:07,409 DEBUG [RS:1;jenkins-hbase4:42313] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 02:01:07,410 DEBUG [RS:1;jenkins-hbase4:42313] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 02:01:07,411 DEBUG [RS:1;jenkins-hbase4:42313] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 02:01:07,411 DEBUG [RS:1;jenkins-hbase4:42313] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 02:01:07,411 DEBUG [RS:1;jenkins-hbase4:42313] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:07,411 DEBUG [RS:1;jenkins-hbase4:42313] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42313,1695866465812' 2023-09-28 02:01:07,411 DEBUG [RS:1;jenkins-hbase4:42313] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:07,412 DEBUG [RS:1;jenkins-hbase4:42313] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:07,412 INFO [RS:2;jenkins-hbase4:46883] regionserver.Replication(203): jenkins-hbase4.apache.org,46883,1695866465849 started 2023-09-28 02:01:07,412 INFO [RS:0;jenkins-hbase4:41721] regionserver.Replication(203): jenkins-hbase4.apache.org,41721,1695866465754 started 2023-09-28 02:01:07,412 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46883,1695866465849, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46883, sessionid=0x100f043dd070003 2023-09-28 02:01:07,412 INFO [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41721,1695866465754, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41721, sessionid=0x100f043dd070001 2023-09-28 02:01:07,412 DEBUG [RS:2;jenkins-hbase4:46883] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 02:01:07,412 DEBUG [RS:0;jenkins-hbase4:41721] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-28 02:01:07,413 DEBUG [RS:1;jenkins-hbase4:42313] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 02:01:07,413 DEBUG [RS:0;jenkins-hbase4:41721] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:07,412 DEBUG [RS:2;jenkins-hbase4:46883] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:07,413 DEBUG [RS:0;jenkins-hbase4:41721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41721,1695866465754' 2023-09-28 02:01:07,413 INFO [RS:1;jenkins-hbase4:42313] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 02:01:07,414 DEBUG [RS:0;jenkins-hbase4:41721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 02:01:07,414 DEBUG [RS:2;jenkins-hbase4:46883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46883,1695866465849' 2023-09-28 02:01:07,414 INFO [RS:1;jenkins-hbase4:42313] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 02:01:07,415 DEBUG [RS:2;jenkins-hbase4:46883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-28 02:01:07,415 DEBUG [RS:0;jenkins-hbase4:41721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 02:01:07,415 DEBUG [RS:2;jenkins-hbase4:46883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-28 02:01:07,415 DEBUG [RS:0;jenkins-hbase4:41721] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 02:01:07,416 DEBUG [RS:0;jenkins-hbase4:41721] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 02:01:07,416 DEBUG [RS:0;jenkins-hbase4:41721] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:07,416 DEBUG [RS:0;jenkins-hbase4:41721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41721,1695866465754' 2023-09-28 02:01:07,416 DEBUG [RS:0;jenkins-hbase4:41721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:07,416 DEBUG [RS:2;jenkins-hbase4:46883] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-28 02:01:07,416 DEBUG [RS:2;jenkins-hbase4:46883] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-28 02:01:07,416 DEBUG [RS:2;jenkins-hbase4:46883] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:07,417 DEBUG [RS:2;jenkins-hbase4:46883] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46883,1695866465849' 2023-09-28 02:01:07,417 DEBUG [RS:2;jenkins-hbase4:46883] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:07,417 DEBUG [RS:0;jenkins-hbase4:41721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:07,417 DEBUG [RS:2;jenkins-hbase4:46883] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:07,417 DEBUG [RS:0;jenkins-hbase4:41721] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 02:01:07,417 INFO [RS:0;jenkins-hbase4:41721] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 02:01:07,418 INFO [RS:0;jenkins-hbase4:41721] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 02:01:07,420 DEBUG [RS:2;jenkins-hbase4:46883] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-28 02:01:07,420 INFO [RS:2;jenkins-hbase4:46883] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-28 02:01:07,420 INFO [RS:2;jenkins-hbase4:46883] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-28 02:01:07,488 DEBUG [jenkins-hbase4:44049] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-28 02:01:07,492 DEBUG [jenkins-hbase4:44049] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:01:07,498 DEBUG [jenkins-hbase4:44049] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:01:07,499 DEBUG [jenkins-hbase4:44049] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:01:07,499 DEBUG [jenkins-hbase4:44049] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:01:07,499 DEBUG [jenkins-hbase4:44049] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:01:07,502 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46883,1695866465849, state=OPENING 2023-09-28 02:01:07,509 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-28 02:01:07,512 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:01:07,513 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-28 02:01:07,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:01:07,527 INFO [RS:1;jenkins-hbase4:42313] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42313%2C1695866465812, suffix=, logDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,42313,1695866465812, archiveDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/oldWALs, maxLogs=32 2023-09-28 02:01:07,527 INFO [RS:2;jenkins-hbase4:46883] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46883%2C1695866465849, suffix=, logDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,46883,1695866465849, archiveDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/oldWALs, maxLogs=32 2023-09-28 02:01:07,528 INFO [RS:0;jenkins-hbase4:41721] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41721%2C1695866465754, suffix=, logDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,41721,1695866465754, archiveDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/oldWALs, maxLogs=32 2023-09-28 02:01:07,561 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK] 2023-09-28 02:01:07,562 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK] 2023-09-28 02:01:07,581 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK] 2023-09-28 02:01:07,581 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK] 2023-09-28 02:01:07,582 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK] 2023-09-28 02:01:07,582 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK] 2023-09-28 02:01:07,582 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK] 2023-09-28 02:01:07,583 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK] 2023-09-28 02:01:07,583 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK] 2023-09-28 02:01:07,597 INFO [RS:2;jenkins-hbase4:46883] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,46883,1695866465849/jenkins-hbase4.apache.org%2C46883%2C1695866465849.1695866467534 2023-09-28 02:01:07,597 INFO [RS:1;jenkins-hbase4:42313] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,42313,1695866465812/jenkins-hbase4.apache.org%2C42313%2C1695866465812.1695866467533 2023-09-28 02:01:07,597 INFO [RS:0;jenkins-hbase4:41721] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,41721,1695866465754/jenkins-hbase4.apache.org%2C41721%2C1695866465754.1695866467534 2023-09-28 02:01:07,597 DEBUG [RS:2;jenkins-hbase4:46883] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK], DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK], DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK]] 2023-09-28 02:01:07,601 DEBUG [RS:1;jenkins-hbase4:42313] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK], DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK], DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK]] 2023-09-28 02:01:07,601 DEBUG [RS:0;jenkins-hbase4:41721] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK], DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK], DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK]] 2023-09-28 02:01:07,712 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:07,715 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 02:01:07,718 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 02:01:07,735 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-28 02:01:07,736 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-28 02:01:07,740 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46883%2C1695866465849.meta, suffix=.meta, logDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,46883,1695866465849, archiveDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/oldWALs, maxLogs=32 2023-09-28 02:01:07,767 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK] 2023-09-28 02:01:07,768 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK] 2023-09-28 02:01:07,768 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK] 2023-09-28 02:01:07,774 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/WALs/jenkins-hbase4.apache.org,46883,1695866465849/jenkins-hbase4.apache.org%2C46883%2C1695866465849.meta.1695866467742.meta 2023-09-28 02:01:07,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43693,DS-35bba228-6e8b-479f-b553-c69a96d937b3,DISK], DatanodeInfoWithStorage[127.0.0.1:45411,DS-3417f538-4784-4f70-a58d-f97c0f5b2d71,DISK], DatanodeInfoWithStorage[127.0.0.1:40073,DS-3501e0cb-f9af-49f8-bf25-31b7760e6e72,DISK]] 2023-09-28 02:01:07,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-28 02:01:07,777 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-28 02:01:07,778 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:07,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-28 02:01:07,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-28 02:01:07,783 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-28 02:01:07,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-28 02:01:07,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:07,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-28 02:01:07,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-28 02:01:07,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-28 02:01:07,803 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/info 2023-09-28 02:01:07,803 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/info 2023-09-28 02:01:07,804 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-28 02:01:07,804 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:07,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-28 02:01:07,806 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/rep_barrier 2023-09-28 02:01:07,806 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/rep_barrier 2023-09-28 02:01:07,807 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-28 02:01:07,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:07,808 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-28 02:01:07,809 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/table 2023-09-28 02:01:07,809 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/table 2023-09-28 02:01:07,810 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-28 02:01:07,811 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:07,813 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740 2023-09-28 02:01:07,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740 2023-09-28 02:01:07,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-28 02:01:07,822 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-28 02:01:07,824 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66951827, jitterRate=-0.0023400336503982544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-28 02:01:07,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-28 02:01:07,839 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695866467704 2023-09-28 02:01:07,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-28 02:01:07,860 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-28 02:01:07,860 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46883,1695866465849, state=OPEN 2023-09-28 02:01:07,863 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-28 02:01:07,863 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-28 02:01:07,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-28 02:01:07,868 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46883,1695866465849 in 347 msec 2023-09-28 02:01:07,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-28 02:01:07,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 555 msec 2023-09-28 02:01:07,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 902 msec 2023-09-28 02:01:07,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695866467880, completionTime=-1 2023-09-28 02:01:07,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-28 02:01:07,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-28 02:01:07,956 DEBUG [hconnection-0x52070e30-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:07,959 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:07,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-28 02:01:07,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695866527983 2023-09-28 02:01:07,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695866587983 2023-09-28 02:01:07,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 103 msec 2023-09-28 02:01:08,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44049,1695866464521-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:08,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44049,1695866464521-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:08,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44049,1695866464521-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:08,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44049, period=300000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:08,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-28 02:01:08,027 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-28 02:01:08,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-28 02:01:08,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 02:01:08,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-28 02:01:08,057 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 02:01:08,060 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 02:01:08,086 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:01:08,089 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464 empty. 2023-09-28 02:01:08,090 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:01:08,090 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-28 02:01:08,128 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-28 02:01:08,131 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 95f39af6ec1e3edf7b711cf6cb108464, NAME => 'hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:01:08,154 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:08,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 95f39af6ec1e3edf7b711cf6cb108464, disabling compactions & flushes 2023-09-28 02:01:08,155 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:01:08,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:01:08,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. after waiting 0 ms 2023-09-28 02:01:08,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:01:08,155 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:01:08,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 95f39af6ec1e3edf7b711cf6cb108464: 2023-09-28 02:01:08,160 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 02:01:08,214 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695866468163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866468163"}]},"ts":"1695866468163"} 2023-09-28 02:01:08,246 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-28 02:01:08,248 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 02:01:08,253 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866468249"}]},"ts":"1695866468249"} 2023-09-28 02:01:08,259 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-28 02:01:08,265 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:01:08,267 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:01:08,267 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:01:08,267 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:01:08,267 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:01:08,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=95f39af6ec1e3edf7b711cf6cb108464, ASSIGN}] 2023-09-28 02:01:08,273 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=95f39af6ec1e3edf7b711cf6cb108464, ASSIGN 2023-09-28 02:01:08,275 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=95f39af6ec1e3edf7b711cf6cb108464, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42313,1695866465812; forceNewPlan=false, retain=false 2023-09-28 02:01:08,428 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 02:01:08,429 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=95f39af6ec1e3edf7b711cf6cb108464, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:08,429 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695866468429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866468429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866468429"}]},"ts":"1695866468429"} 2023-09-28 02:01:08,435 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 95f39af6ec1e3edf7b711cf6cb108464, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:01:08,590 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:08,590 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 02:01:08,594 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 02:01:08,602 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:01:08,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 95f39af6ec1e3edf7b711cf6cb108464, NAME => 'hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464.', STARTKEY => '', ENDKEY => ''} 2023-09-28 02:01:08,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. service=AccessControlService 2023-09-28 02:01:08,603 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:08,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:01:08,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:08,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:01:08,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:01:08,607 INFO [StoreOpener-95f39af6ec1e3edf7b711cf6cb108464-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:01:08,609 DEBUG [StoreOpener-95f39af6ec1e3edf7b711cf6cb108464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464/info 2023-09-28 02:01:08,609 DEBUG [StoreOpener-95f39af6ec1e3edf7b711cf6cb108464-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464/info 2023-09-28 02:01:08,610 INFO [StoreOpener-95f39af6ec1e3edf7b711cf6cb108464-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 95f39af6ec1e3edf7b711cf6cb108464 columnFamilyName info 2023-09-28 02:01:08,610 INFO [StoreOpener-95f39af6ec1e3edf7b711cf6cb108464-1] regionserver.HStore(310): Store=95f39af6ec1e3edf7b711cf6cb108464/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:08,612 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:01:08,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:01:08,617 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:01:08,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:08,622 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 95f39af6ec1e3edf7b711cf6cb108464; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64919806, jitterRate=-0.03261950612068176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:01:08,622 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 95f39af6ec1e3edf7b711cf6cb108464: 2023-09-28 02:01:08,624 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464., pid=6, masterSystemTime=1695866468590 2023-09-28 02:01:08,629 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:01:08,630 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:01:08,631 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=95f39af6ec1e3edf7b711cf6cb108464, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:08,632 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695866468631"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866468631"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866468631"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866468631"}]},"ts":"1695866468631"} 2023-09-28 02:01:08,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-28 02:01:08,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 95f39af6ec1e3edf7b711cf6cb108464, server=jenkins-hbase4.apache.org,42313,1695866465812 in 200 msec 2023-09-28 02:01:08,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-28 02:01:08,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=95f39af6ec1e3edf7b711cf6cb108464, ASSIGN in 369 msec 2023-09-28 02:01:08,645 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 02:01:08,645 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866468645"}]},"ts":"1695866468645"} 2023-09-28 02:01:08,648 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-28 02:01:08,652 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 02:01:08,655 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 610 msec 2023-09-28 02:01:08,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-28 02:01:08,658 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-28 02:01:08,658 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:01:08,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:08,683 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:08,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-28 02:01:08,715 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-28 02:01:08,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-09-28 02:01:08,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-28 02:01:08,743 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-28 02:01:08,749 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-28 02:01:08,759 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-28 02:01:08,762 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-28 02:01:08,762 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.843sec 2023-09-28 02:01:08,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-28 02:01:08,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-28 02:01:08,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-28 02:01:08,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44049,1695866464521-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-28 02:01:08,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44049,1695866464521-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-28 02:01:08,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-28 02:01:08,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-28 02:01:08,794 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 02:01:08,796 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 02:01:08,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-28 02:01:08,799 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:01:08,800 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd empty. 2023-09-28 02:01:08,804 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:01:08,804 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-28 02:01:08,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 02:01:08,815 DEBUG [Listener at localhost/36725] zookeeper.ReadOnlyZKClient(139): Connect 0x5664efd5 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:08,824 DEBUG [Listener at localhost/36725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@770c99c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:08,833 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-28 02:01:08,834 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => c79ed97ce3e02c2797c8a9084a3e5efd, NAME => 'hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:01:08,847 DEBUG [hconnection-0x1efc3b9f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:08,868 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:08,868 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing c79ed97ce3e02c2797c8a9084a3e5efd, disabling compactions & flushes 2023-09-28 02:01:08,868 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:01:08,868 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:01:08,868 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. after waiting 0 ms 2023-09-28 02:01:08,868 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:01:08,868 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:01:08,869 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for c79ed97ce3e02c2797c8a9084a3e5efd: 2023-09-28 02:01:08,872 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:08,874 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 02:01:08,875 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:01:08,875 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695866468875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866468875"}]},"ts":"1695866468875"} 2023-09-28 02:01:08,875 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-28 02:01:08,875 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/test.cache.data in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop.tmp.dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop.log.dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-28 02:01:08,876 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 02:01:08,877 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-28 02:01:08,877 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/nfs.dump.dir in system properties and HBase conf 2023-09-28 02:01:08,877 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir in system properties and HBase conf 2023-09-28 02:01:08,877 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-28 02:01:08,877 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-28 02:01:08,877 INFO [Listener at localhost/36725] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-28 02:01:08,883 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-28 02:01:08,885 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 02:01:08,885 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866468885"}]},"ts":"1695866468885"} 2023-09-28 02:01:08,888 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-28 02:01:08,894 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:01:08,895 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:01:08,895 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:01:08,895 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:01:08,895 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:01:08,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=c79ed97ce3e02c2797c8a9084a3e5efd, ASSIGN}] 2023-09-28 02:01:08,899 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=c79ed97ce3e02c2797c8a9084a3e5efd, ASSIGN 2023-09-28 02:01:08,900 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=c79ed97ce3e02c2797c8a9084a3e5efd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46883,1695866465849; forceNewPlan=false, retain=false 2023-09-28 02:01:08,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 02:01:09,051 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 02:01:09,052 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c79ed97ce3e02c2797c8a9084a3e5efd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:09,052 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695866469052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866469052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866469052"}]},"ts":"1695866469052"} 2023-09-28 02:01:09,056 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c79ed97ce3e02c2797c8a9084a3e5efd, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:01:09,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 02:01:09,217 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:01:09,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c79ed97ce3e02c2797c8a9084a3e5efd, NAME => 'hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd.', STARTKEY => '', ENDKEY => ''} 2023-09-28 02:01:09,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. service=AccessControlService 2023-09-28 02:01:09,218 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:09,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:01:09,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:09,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:01:09,218 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:01:09,220 INFO [StoreOpener-c79ed97ce3e02c2797c8a9084a3e5efd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:01:09,222 DEBUG [StoreOpener-c79ed97ce3e02c2797c8a9084a3e5efd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd/l 2023-09-28 02:01:09,223 DEBUG [StoreOpener-c79ed97ce3e02c2797c8a9084a3e5efd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd/l 2023-09-28 02:01:09,223 INFO [StoreOpener-c79ed97ce3e02c2797c8a9084a3e5efd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c79ed97ce3e02c2797c8a9084a3e5efd columnFamilyName l 2023-09-28 02:01:09,224 INFO [StoreOpener-c79ed97ce3e02c2797c8a9084a3e5efd-1] regionserver.HStore(310): Store=c79ed97ce3e02c2797c8a9084a3e5efd/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:09,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:01:09,227 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:01:09,232 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:01:09,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:09,237 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c79ed97ce3e02c2797c8a9084a3e5efd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73774681, jitterRate=0.09932841360569}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:01:09,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c79ed97ce3e02c2797c8a9084a3e5efd: 2023-09-28 02:01:09,239 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd., pid=11, masterSystemTime=1695866469210 2023-09-28 02:01:09,242 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:01:09,242 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:01:09,243 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c79ed97ce3e02c2797c8a9084a3e5efd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:09,244 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695866469243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866469243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866469243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866469243"}]},"ts":"1695866469243"} 2023-09-28 02:01:09,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-28 02:01:09,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c79ed97ce3e02c2797c8a9084a3e5efd, server=jenkins-hbase4.apache.org,46883,1695866465849 in 191 msec 2023-09-28 02:01:09,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-28 02:01:09,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=c79ed97ce3e02c2797c8a9084a3e5efd, ASSIGN in 356 msec 2023-09-28 02:01:09,256 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 02:01:09,257 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866469256"}]},"ts":"1695866469256"} 2023-09-28 02:01:09,259 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-28 02:01:09,262 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 02:01:09,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 473 msec 2023-09-28 02:01:09,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-28 02:01:09,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-28 02:01:09,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-28 02:01:10,037 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 02:01:10,407 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 02:01:10,414 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_32829_jobhistory____.58i9sn/webapp 2023-09-28 02:01:10,590 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-28 02:01:10,590 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-28 02:01:10,591 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 02:01:10,594 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 02:01:10,684 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:11,024 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:11,324 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-28 02:01:11,362 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:32829 2023-09-28 02:01:11,534 WARN [Listener at jenkins-hbase4.apache.org/43209] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 02:01:11,819 WARN [Listener at jenkins-hbase4.apache.org/43209] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 02:01:11,820 INFO [Listener at jenkins-hbase4.apache.org/43209] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 02:01:11,830 INFO [Listener at jenkins-hbase4.apache.org/43209] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41607_cluster____rl0u4k/webapp 2023-09-28 02:01:11,907 INFO [Listener at jenkins-hbase4.apache.org/43209] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 02:01:11,907 INFO [Listener at jenkins-hbase4.apache.org/43209] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-28 02:01:11,907 INFO [Listener at jenkins-hbase4.apache.org/43209] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 02:01:11,908 INFO [Listener at jenkins-hbase4.apache.org/43209] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 02:01:11,916 INFO [Listener at jenkins-hbase4.apache.org/43209] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:12,118 INFO [Listener at jenkins-hbase4.apache.org/43209] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:12,206 INFO [Listener at jenkins-hbase4.apache.org/43209] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:12,214 INFO [Listener at jenkins-hbase4.apache.org/43209] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41607 2023-09-28 02:01:12,667 WARN [Listener at jenkins-hbase4.apache.org/37059] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 02:01:12,694 WARN [Listener at jenkins-hbase4.apache.org/37059] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 02:01:12,694 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 02:01:12,701 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35773_node____q1j75b/webapp 2023-09-28 02:01:12,755 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-28 02:01:12,755 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 02:01:12,755 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 02:01:12,755 INFO [Listener at jenkins-hbase4.apache.org/37059] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 02:01:12,764 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:12,785 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:12,903 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:12,915 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35773 2023-09-28 02:01:13,092 WARN [Listener at jenkins-hbase4.apache.org/34629] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-28 02:01:13,100 WARN [Listener at jenkins-hbase4.apache.org/34629] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-28 02:01:13,100 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): jetty-6.1.26 2023-09-28 02:01:13,111 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43699_node____2uk4dx/webapp 2023-09-28 02:01:13,165 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-28 02:01:13,165 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-28 02:01:13,166 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-28 02:01:13,166 INFO [Listener at jenkins-hbase4.apache.org/34629] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-28 02:01:13,175 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:13,189 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:13,248 INFO [Listener at jenkins-hbase4.apache.org/34629] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-28 02:01:13,257 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43699 2023-09-28 02:01:13,284 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-28 02:01:13,285 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:01:13,353 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=131, ProcessCount=164, AvailableMemoryMB=5398 2023-09-28 02:01:13,353 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-09-28 02:01:13,360 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 02:01:13,373 DEBUG [Listener at jenkins-hbase4.apache.org/34629] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-28 02:01:13,392 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-28 02:01:13,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 02:01:13,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-28 02:01:13,420 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 02:01:13,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-28 02:01:13,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 02:01:13,423 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 02:01:13,427 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:13,427 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8 2023-09-28 02:01:13,428 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288 empty. 2023-09-28 02:01:13,428 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8 empty. 2023-09-28 02:01:13,433 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:13,433 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8 2023-09-28 02:01:13,433 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-28 02:01:13,477 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-28 02:01:13,479 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => b974da9ef3d35ba13ff8e669dafac288, NAME => 'testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:01:13,479 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0881965d2944225522eac068035019a8, NAME => 'testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:01:13,520 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:13,521 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing b974da9ef3d35ba13ff8e669dafac288, disabling compactions & flushes 2023-09-28 02:01:13,521 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:13,521 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:13,521 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. after waiting 0 ms 2023-09-28 02:01:13,521 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:13,521 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:13,521 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for b974da9ef3d35ba13ff8e669dafac288: 2023-09-28 02:01:13,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 02:01:13,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:13,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 0881965d2944225522eac068035019a8, disabling compactions & flushes 2023-09-28 02:01:13,531 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:13,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:13,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. after waiting 0 ms 2023-09-28 02:01:13,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:13,531 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:13,531 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 0881965d2944225522eac068035019a8: 2023-09-28 02:01:13,541 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 02:01:13,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866473542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866473542"}]},"ts":"1695866473542"} 2023-09-28 02:01:13,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866473542"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866473542"}]},"ts":"1695866473542"} 2023-09-28 02:01:13,576 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-28 02:01:13,578 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-28 02:01:13,579 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-28 02:01:13,612 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 02:01:13,614 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 02:01:13,614 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866473614"}]},"ts":"1695866473614"} 2023-09-28 02:01:13,616 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-28 02:01:13,622 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:01:13,624 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:01:13,624 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:01:13,624 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:01:13,625 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:01:13,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b974da9ef3d35ba13ff8e669dafac288, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0881965d2944225522eac068035019a8, ASSIGN}] 2023-09-28 02:01:13,628 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0881965d2944225522eac068035019a8, ASSIGN 2023-09-28 02:01:13,629 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b974da9ef3d35ba13ff8e669dafac288, ASSIGN 2023-09-28 02:01:13,630 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b974da9ef3d35ba13ff8e669dafac288, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42313,1695866465812; forceNewPlan=false, retain=false 2023-09-28 02:01:13,630 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0881965d2944225522eac068035019a8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46883,1695866465849; forceNewPlan=false, retain=false 2023-09-28 02:01:13,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 02:01:13,780 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 02:01:13,783 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0881965d2944225522eac068035019a8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:13,783 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b974da9ef3d35ba13ff8e669dafac288, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:13,783 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866473783"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866473783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866473783"}]},"ts":"1695866473783"} 2023-09-28 02:01:13,783 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866473783"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866473783"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866473783"}]},"ts":"1695866473783"} 2023-09-28 02:01:13,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 0881965d2944225522eac068035019a8, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:01:13,788 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure b974da9ef3d35ba13ff8e669dafac288, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:01:13,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:13,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:13,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0881965d2944225522eac068035019a8, NAME => 'testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 02:01:13,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b974da9ef3d35ba13ff8e669dafac288, NAME => 'testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 02:01:13,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. service=AccessControlService 2023-09-28 02:01:13,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. service=AccessControlService 2023-09-28 02:01:13,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:13,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:13,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:13,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:13,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 0881965d2944225522eac068035019a8 2023-09-28 02:01:13,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:13,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:13,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:13,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0881965d2944225522eac068035019a8 2023-09-28 02:01:13,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0881965d2944225522eac068035019a8 2023-09-28 02:01:13,957 INFO [StoreOpener-0881965d2944225522eac068035019a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0881965d2944225522eac068035019a8 2023-09-28 02:01:13,957 INFO [StoreOpener-b974da9ef3d35ba13ff8e669dafac288-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:13,959 DEBUG [StoreOpener-0881965d2944225522eac068035019a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/cf 2023-09-28 02:01:13,959 DEBUG [StoreOpener-b974da9ef3d35ba13ff8e669dafac288-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/cf 2023-09-28 02:01:13,959 DEBUG [StoreOpener-0881965d2944225522eac068035019a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/cf 2023-09-28 02:01:13,959 DEBUG [StoreOpener-b974da9ef3d35ba13ff8e669dafac288-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/cf 2023-09-28 02:01:13,963 INFO [StoreOpener-0881965d2944225522eac068035019a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0881965d2944225522eac068035019a8 columnFamilyName cf 2023-09-28 02:01:13,963 INFO [StoreOpener-b974da9ef3d35ba13ff8e669dafac288-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b974da9ef3d35ba13ff8e669dafac288 columnFamilyName cf 2023-09-28 02:01:13,966 INFO [StoreOpener-0881965d2944225522eac068035019a8-1] regionserver.HStore(310): Store=0881965d2944225522eac068035019a8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:13,967 INFO [StoreOpener-b974da9ef3d35ba13ff8e669dafac288-1] regionserver.HStore(310): Store=b974da9ef3d35ba13ff8e669dafac288/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:13,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8 2023-09-28 02:01:13,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:13,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8 2023-09-28 02:01:13,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:13,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0881965d2944225522eac068035019a8 2023-09-28 02:01:13,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:13,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:13,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:13,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0881965d2944225522eac068035019a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72312800, jitterRate=0.0775446891784668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:01:13,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0881965d2944225522eac068035019a8: 2023-09-28 02:01:13,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b974da9ef3d35ba13ff8e669dafac288; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59508134, jitterRate=-0.1132597029209137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:01:13,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b974da9ef3d35ba13ff8e669dafac288: 2023-09-28 02:01:13,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8., pid=15, masterSystemTime=1695866473939 2023-09-28 02:01:13,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288., pid=16, masterSystemTime=1695866473940 2023-09-28 02:01:13,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:13,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:13,996 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=0881965d2944225522eac068035019a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:13,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:13,996 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866473995"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866473995"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866473995"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866473995"}]},"ts":"1695866473995"} 2023-09-28 02:01:13,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:13,997 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b974da9ef3d35ba13ff8e669dafac288, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:13,998 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866473997"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866473997"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866473997"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866473997"}]},"ts":"1695866473997"} 2023-09-28 02:01:14,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-28 02:01:14,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 0881965d2944225522eac068035019a8, server=jenkins-hbase4.apache.org,46883,1695866465849 in 214 msec 2023-09-28 02:01:14,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-28 02:01:14,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure b974da9ef3d35ba13ff8e669dafac288, server=jenkins-hbase4.apache.org,42313,1695866465812 in 215 msec 2023-09-28 02:01:14,009 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0881965d2944225522eac068035019a8, ASSIGN in 380 msec 2023-09-28 02:01:14,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-28 02:01:14,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b974da9ef3d35ba13ff8e669dafac288, ASSIGN in 383 msec 2023-09-28 02:01:14,012 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 02:01:14,012 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866474012"}]},"ts":"1695866474012"} 2023-09-28 02:01:14,014 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-28 02:01:14,018 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 02:01:14,024 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-28 02:01:14,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 02:01:14,046 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 02:01:14,080 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:14,080 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:14,080 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:14,080 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:14,081 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:01:14,089 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:14,089 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:14,089 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:14,090 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:14,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:14,091 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:14,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 681 msec 2023-09-28 02:01:14,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-28 02:01:14,536 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-28 02:01:14,540 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-28 02:01:14,541 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:14,544 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:01:14,572 DEBUG [hconnection-0x1efc3b9f-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:14,575 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:14,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 02:01:14,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866474598 (current time:1695866474598). 2023-09-28 02:01:14,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:01:14,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x48195743 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:14,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@740a8acf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:14,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:14,609 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:14,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48195743 to 127.0.0.1:56493 2023-09-28 02:01:14,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:14,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x63ab315e to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:14,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f3b4c7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:14,622 DEBUG [hconnection-0x3da6018c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:14,624 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:14,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63ab315e to 127.0.0.1:56493 2023-09-28 02:01:14,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:14,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 02:01:14,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:01:14,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 02:01:14,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 02:01:14,686 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 02:01:14,688 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695867074688 2023-09-28 02:01:14,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 02:01:14,688 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-28 02:01:14,691 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 02:01:14,691 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:01:14,692 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-28 02:01:14,692 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:01:14,693 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-28 02:01:14,693 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-28 02:01:14,693 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-28 02:01:14,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 02:01:14,693 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:01:14,693 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-28 02:01:14,693 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-28 02:01:14,693 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-28 02:01:14,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-09-28 02:01:14,695 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 02:01:14,696 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695867074696 2023-09-28 02:01:14,697 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:01:14,697 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:01:14,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,727 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-28 02:01:14,727 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:14,728 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-28 02:01:14,728 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-28 02:01:14,729 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,729 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,734 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:14,734 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:14,734 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:14,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:14,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:14,735 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:14,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:14,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:14,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:14,735 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,735 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,736 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,736 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:01:14,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 02:01:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 02:01:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-28 02:01:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 02:01:14,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 02:01:14,738 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 02:01:14,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,741 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,741 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 02:01:14,741 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:14,741 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 02:01:14,742 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 02:01:14,741 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 02:01:14,742 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 02:01:14,742 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:14,743 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 02:01:14,744 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 02:01:14,743 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:14,744 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 02:01:14,744 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 02:01:14,744 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 02:01:14,745 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-28 02:01:14,745 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-28 02:01:14,747 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,747 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:14,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:14,748 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,748 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,748 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,748 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,748 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:14,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:14,749 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,749 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,749 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:14,749 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:14,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:14,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:14,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-28 02:01:14,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c39fc4[Count = 1] remaining members to acquire global barrier 2023-09-28 02:01:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:14,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:14,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:14,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:14,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:14,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-28 02:01:14,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26c39fc4[Count = 0] remaining members to acquire global barrier 2023-09-28 02:01:14,754 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-28 02:01:14,755 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,758 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,758 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,758 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,758 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 02:01:14,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,758 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 02:01:14,758 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,759 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 02:01:14,759 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 02:01:14,759 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:01:14,759 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,759 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:01:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:14,765 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:14,765 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:14,765 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 02:01:14,766 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. started... 2023-09-28 02:01:14,766 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. started... 2023-09-28 02:01:14,766 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:14,766 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 02:01:14,770 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0881965d2944225522eac068035019a8: 2023-09-28 02:01:14,770 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b974da9ef3d35ba13ff8e669dafac288: 2023-09-28 02:01:14,771 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,771 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,777 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:14,777 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:14,780 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:01:14,780 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:01:14,798 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:14,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 02:01:14,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:01:14,823 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. completed. 2023-09-28 02:01:14,823 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:14,823 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:01:14,824 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:14,824 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:14,824 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,824 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 02:01:14,824 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. completed. 2023-09-28 02:01:14,824 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:01:14,825 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:14,825 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:14,825 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:14,825 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,825 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-28 02:01:14,825 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:01:14,826 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 02:01:14,826 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,827 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:14,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,827 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 02:01:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:14,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:14,828 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 02:01:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:14,828 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-28 02:01:14,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:14,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:14,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:01:14,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-28 02:01:14,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:14,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:14,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:14,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:14,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:14,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:01:14,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-28 02:01:14,838 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-28 02:01:14,838 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:01:14,838 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:01:14,838 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,839 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:01:14,842 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:14,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:14,843 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:14,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,843 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:14,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:14,844 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,845 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,848 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,848 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,849 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,862 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,862 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:14,862 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:14,862 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:14,862 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:14,863 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:14,863 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:14,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:14,863 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:14,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,863 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,864 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-28 02:01:14,863 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:14,864 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,864 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:01:14,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:14,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:14,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:14,864 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:14,865 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,865 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:14,865 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:14,865 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,865 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:14,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:14,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:14,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:14,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:14,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 02:01:14,885 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,944 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-28 02:01:14,944 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,944 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:14,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695866474688Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695866474885 (+197 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695866474885Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695866474885Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695866474899 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695866474929 (+30 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695866474944 (+15 ms) 2023-09-28 02:01:14,947 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 02:01:14,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 255 msec 2023-09-28 02:01:15,024 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:15,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 02:01:15,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:01:15,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42313] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:01:15,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46883] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:01:15,050 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-28 02:01:15,051 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:15,051 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:01:15,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 02:01:15,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866475066 (current time:1695866475066). 2023-09-28 02:01:15,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:01:15,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x4ceb0607 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:15,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c7f4f38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:15,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:15,078 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:15,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ceb0607 to 127.0.0.1:56493 2023-09-28 02:01:15,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:15,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x6089d7d7 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:15,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74c63eff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:15,089 DEBUG [hconnection-0x12a6a9d0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:15,090 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:15,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6089d7d7 to 127.0.0.1:56493 2023-09-28 02:01:15,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:15,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-28 02:01:15,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:01:15,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 02:01:15,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 02:01:15,101 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 02:01:15,103 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695867075103 2023-09-28 02:01:15,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-28 02:01:15,103 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-28 02:01:15,104 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:01:15,104 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:01:15,106 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-28 02:01:15,106 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 02:01:15,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-28 02:01:15,108 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 02:01:15,109 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695867075109 2023-09-28 02:01:15,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-28 02:01:15,129 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-28 02:01:15,129 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:15,130 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-28 02:01:15,130 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-28 02:01:15,131 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,131 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,132 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:15,132 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:15,132 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:15,132 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:15,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:15,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:15,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:15,133 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:15,133 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,133 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,133 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:01:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 02:01:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 02:01:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-28 02:01:15,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,135 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 02:01:15,135 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 02:01:15,135 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-28 02:01:15,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 02:01:15,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 02:01:15,135 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 02:01:15,135 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 02:01:15,135 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:15,135 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:15,137 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 02:01:15,137 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-28 02:01:15,137 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 02:01:15,137 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 02:01:15,137 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 02:01:15,137 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 02:01:15,137 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-28 02:01:15,137 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:15,137 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 02:01:15,138 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-28 02:01:15,138 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-28 02:01:15,138 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-28 02:01:15,140 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:15,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,142 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:15,142 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:15,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 02:01:15,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:15,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-28 02:01:15,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b7b7f91[Count = 1] remaining members to acquire global barrier 2023-09-28 02:01:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:15,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 02:01:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:15,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-28 02:01:15,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b7b7f91[Count = 0] remaining members to acquire global barrier 2023-09-28 02:01:15,147 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-28 02:01:15,147 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,151 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,151 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,151 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,151 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 02:01:15,151 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,151 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 02:01:15,152 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:15,152 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,152 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:15,152 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 02:01:15,152 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,152 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. started... 2023-09-28 02:01:15,152 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-28 02:01:15,152 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:01:15,152 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:01:15,152 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:15,152 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:15,152 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0881965d2944225522eac068035019a8 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-28 02:01:15,152 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:15,152 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. started... 2023-09-28 02:01:15,153 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b974da9ef3d35ba13ff8e669dafac288 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-28 02:01:15,155 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 02:01:15,155 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:15,155 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 02:01:15,204 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:15,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 02:01:15,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:01:15,206 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:01:15,302 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928844b6209bd2e4543865b1fc49615ccea to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928844b6209bd2e4543865b1fc49615ccea 2023-09-28 02:01:15,302 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309287e773b44c1b54d74af537ad05bcb4135 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309287e773b44c1b54d74af537ad05bcb4135 2023-09-28 02:01:15,342 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/.tmp/cf/ecdb67bfd63647c197a0023782341c76 2023-09-28 02:01:15,344 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/.tmp/cf/aca394835f6a4907a741aa6335f0de50 2023-09-28 02:01:15,355 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/.tmp/cf/aca394835f6a4907a741aa6335f0de50 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/cf/aca394835f6a4907a741aa6335f0de50 2023-09-28 02:01:15,357 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/.tmp/cf/ecdb67bfd63647c197a0023782341c76 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/cf/ecdb67bfd63647c197a0023782341c76 2023-09-28 02:01:15,364 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/cf/aca394835f6a4907a741aa6335f0de50, entries=47, sequenceid=6, filesize=12.8 K 2023-09-28 02:01:15,367 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/cf/ecdb67bfd63647c197a0023782341c76, entries=3, sequenceid=6, filesize=5.4 K 2023-09-28 02:01:15,370 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b974da9ef3d35ba13ff8e669dafac288 in 217ms, sequenceid=6, compaction requested=false 2023-09-28 02:01:15,370 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0881965d2944225522eac068035019a8 in 218ms, sequenceid=6, compaction requested=false 2023-09-28 02:01:15,370 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-28 02:01:15,370 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-28 02:01:15,372 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0881965d2944225522eac068035019a8: 2023-09-28 02:01:15,372 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b974da9ef3d35ba13ff8e669dafac288: 2023-09-28 02:01:15,373 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 02:01:15,373 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 02:01:15,373 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:15,373 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:15,373 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/cf/ecdb67bfd63647c197a0023782341c76] hfiles 2023-09-28 02:01:15,373 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/cf/aca394835f6a4907a741aa6335f0de50] hfiles 2023-09-28 02:01:15,373 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/cf/ecdb67bfd63647c197a0023782341c76 for snapshot=snaptb0-testExportWithTargetName 2023-09-28 02:01:15,374 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/cf/aca394835f6a4907a741aa6335f0de50 for snapshot=snaptb0-testExportWithTargetName 2023-09-28 02:01:15,398 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. completed. 2023-09-28 02:01:15,398 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:01:15,399 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. completed. 2023-09-28 02:01:15,399 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-28 02:01:15,399 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:01:15,401 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,401 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 02:01:15,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:15,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:15,401 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:15,401 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 02:01:15,403 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,403 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-28 02:01:15,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:15,403 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:15,403 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-28 02:01:15,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:15,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 02:01:15,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,407 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:15,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:15,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 02:01:15,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 02:01:15,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:01:15,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,409 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-28 02:01:15,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:01:15,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-28 02:01:15,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:15,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:15,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:15,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:15,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 02:01:15,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 02:01:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:01:15,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-28 02:01:15,415 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-28 02:01:15,415 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:01:15,415 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:01:15,415 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-28 02:01:15,415 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:01:15,417 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,417 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,417 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,417 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:15,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,417 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:15,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,417 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:15,418 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,418 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:15,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:15,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:15,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:15,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:15,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,419 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 02:01:15,419 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:15,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 02:01:15,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:15,422 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-28 02:01:15,422 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,423 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:15,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:15,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:15,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:15,434 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:15,434 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:15,435 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-28 02:01:15,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:15,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:01:15,436 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:15,436 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,436 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:15,436 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:15,436 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,436 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:15,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:15,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:15,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:15,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:15,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:15,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:15,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309287e773b44c1b54d74af537ad05bcb4135, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928844b6209bd2e4543865b1fc49615ccea] mob files 2023-09-28 02:01:15,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309287e773b44c1b54d74af537ad05bcb4135 2023-09-28 02:01:15,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928844b6209bd2e4543865b1fc49615ccea 2023-09-28 02:01:15,456 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-28 02:01:15,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-28 02:01:15,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,499 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-28 02:01:15,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695866475103Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695866475456 (+353 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695866475456Loading Region manifests for snaptb0-testExportWithTargetName at 1695866475456Writing data manifest for snaptb0-testExportWithTargetName at 1695866475463 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695866475486 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695866475499 (+13 ms) 2023-09-28 02:01:15,502 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-28 02:01:15,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 399 msec 2023-09-28 02:01:15,709 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:15,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-28 02:01:15,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:01:15,713 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713 2023-09-28 02:01:15,713 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35003, tgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713, rawTgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713, srcFsUri=hdfs://localhost:35003, srcDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:15,756 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:15,756 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_668700139_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-28 02:01:15,756 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d, snapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-28 02:01:15,780 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-28 02:01:15,853 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:15,854 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:15,855 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:15,855 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:16,825 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-5139446257484228773.jar 2023-09-28 02:01:16,825 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:16,826 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:16,895 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-2328389281649113663.jar 2023-09-28 02:01:16,895 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:16,896 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:16,896 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:16,897 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:16,897 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:16,897 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:16,898 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 02:01:16,899 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 02:01:16,899 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 02:01:16,900 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 02:01:16,900 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 02:01:16,901 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 02:01:16,901 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 02:01:16,901 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 02:01:16,902 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 02:01:16,902 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 02:01:16,907 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:16,908 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:16,908 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:01:16,909 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:16,909 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:16,910 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:01:16,910 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:01:17,709 WARN [Listener at jenkins-hbase4.apache.org/34629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 02:01:17,715 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-28 02:01:17,724 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-28 02:01:18,209 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:01:18,211 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:01:18,446 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0001_000001 (auth:SIMPLE) 2023-09-28 02:01:19,460 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 02:01:22,860 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0001_000001 (auth:SIMPLE) 2023-09-28 02:01:25,126 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0001_000001 (auth:SIMPLE) 2023-09-28 02:01:28,631 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0001_000001 (auth:SIMPLE) 2023-09-28 02:01:30,589 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 02:01:30,592 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 02:01:30,603 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-28 02:01:30,604 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 02:01:30,604 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 02:01:30,605 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-28 02:01:30,605 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-28 02:01:30,605 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-28 02:01:30,605 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713/.hbase-snapshot/testExportWithTargetName 2023-09-28 02:01:30,606 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-28 02:01:30,606 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866475713/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-28 02:01:30,618 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-28 02:01:30,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-28 02:01:30,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-28 02:01:30,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866490637"}]},"ts":"1695866490637"} 2023-09-28 02:01:30,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 02:01:30,645 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-28 02:01:30,675 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-28 02:01:30,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b974da9ef3d35ba13ff8e669dafac288, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0881965d2944225522eac068035019a8, UNASSIGN}] 2023-09-28 02:01:30,680 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b974da9ef3d35ba13ff8e669dafac288, UNASSIGN 2023-09-28 02:01:30,680 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0881965d2944225522eac068035019a8, UNASSIGN 2023-09-28 02:01:30,681 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0881965d2944225522eac068035019a8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:30,681 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b974da9ef3d35ba13ff8e669dafac288, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:30,682 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866490681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866490681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866490681"}]},"ts":"1695866490681"} 2023-09-28 02:01:30,682 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866490681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866490681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866490681"}]},"ts":"1695866490681"} 2023-09-28 02:01:30,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 0881965d2944225522eac068035019a8, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:01:30,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure b974da9ef3d35ba13ff8e669dafac288, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:01:30,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 02:01:30,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0881965d2944225522eac068035019a8 2023-09-28 02:01:30,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:30,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b974da9ef3d35ba13ff8e669dafac288, disabling compactions & flushes 2023-09-28 02:01:30,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0881965d2944225522eac068035019a8, disabling compactions & flushes 2023-09-28 02:01:30,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:30,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:30,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:30,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:30,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. after waiting 0 ms 2023-09-28 02:01:30,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. after waiting 0 ms 2023-09-28 02:01:30,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:30,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:30,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:01:30,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:01:30,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:01:30,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:01:30,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8. 2023-09-28 02:01:30,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288. 2023-09-28 02:01:30,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b974da9ef3d35ba13ff8e669dafac288: 2023-09-28 02:01:30,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0881965d2944225522eac068035019a8: 2023-09-28 02:01:30,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0881965d2944225522eac068035019a8 2023-09-28 02:01:30,868 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0881965d2944225522eac068035019a8, regionState=CLOSED 2023-09-28 02:01:30,869 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866490868"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866490868"}]},"ts":"1695866490868"} 2023-09-28 02:01:30,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:30,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b974da9ef3d35ba13ff8e669dafac288, regionState=CLOSED 2023-09-28 02:01:30,870 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695866490869"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866490869"}]},"ts":"1695866490869"} 2023-09-28 02:01:30,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-09-28 02:01:30,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 0881965d2944225522eac068035019a8, server=jenkins-hbase4.apache.org,46883,1695866465849 in 187 msec 2023-09-28 02:01:30,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=22 2023-09-28 02:01:30,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure b974da9ef3d35ba13ff8e669dafac288, server=jenkins-hbase4.apache.org,42313,1695866465812 in 187 msec 2023-09-28 02:01:30,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=0881965d2944225522eac068035019a8, UNASSIGN in 197 msec 2023-09-28 02:01:30,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-28 02:01:30,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b974da9ef3d35ba13ff8e669dafac288, UNASSIGN in 198 msec 2023-09-28 02:01:30,878 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866490878"}]},"ts":"1695866490878"} 2023-09-28 02:01:30,879 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-28 02:01:30,921 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-28 02:01:30,924 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 296 msec 2023-09-28 02:01:30,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-28 02:01:30,941 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-28 02:01:30,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-28 02:01:30,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 02:01:30,955 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 02:01:30,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-28 02:01:30,957 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 02:01:30,961 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-28 02:01:30,963 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:30,963 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8 2023-09-28 02:01:30,966 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/recovered.edits] 2023-09-28 02:01:30,966 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/recovered.edits] 2023-09-28 02:01:30,974 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/cf/ecdb67bfd63647c197a0023782341c76 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/cf/ecdb67bfd63647c197a0023782341c76 2023-09-28 02:01:30,974 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/cf/aca394835f6a4907a741aa6335f0de50 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/cf/aca394835f6a4907a741aa6335f0de50 2023-09-28 02:01:30,979 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8/recovered.edits/9.seqid 2023-09-28 02:01:30,979 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288/recovered.edits/9.seqid 2023-09-28 02:01:30,979 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/0881965d2944225522eac068035019a8 2023-09-28 02:01:30,980 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportWithTargetName/b974da9ef3d35ba13ff8e669dafac288 2023-09-28 02:01:30,980 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-28 02:01:30,980 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-28 02:01:30,981 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-28 02:01:30,986 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309287e773b44c1b54d74af537ad05bcb4135 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309287e773b44c1b54d74af537ad05bcb4135 2023-09-28 02:01:30,988 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928844b6209bd2e4543865b1fc49615ccea to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230928844b6209bd2e4543865b1fc49615ccea 2023-09-28 02:01:30,988 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-28 02:01:31,007 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 02:01:31,033 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-28 02:01:31,036 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:31,038 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:31,036 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:31,036 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:31,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-28 02:01:31,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-28 02:01:31,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-28 02:01:31,038 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-28 02:01:31,040 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-28 02:01:31,041 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 02:01:31,041 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-28 02:01:31,041 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866491041"}]},"ts":"9223372036854775807"} 2023-09-28 02:01:31,042 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866491041"}]},"ts":"9223372036854775807"} 2023-09-28 02:01:31,044 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 02:01:31,044 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b974da9ef3d35ba13ff8e669dafac288, NAME => 'testtb-testExportWithTargetName,,1695866473408.b974da9ef3d35ba13ff8e669dafac288.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0881965d2944225522eac068035019a8, NAME => 'testtb-testExportWithTargetName,1,1695866473408.0881965d2944225522eac068035019a8.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 02:01:31,044 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-28 02:01:31,044 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695866491044"}]},"ts":"9223372036854775807"} 2023-09-28 02:01:31,046 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-28 02:01:31,082 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:31,082 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:31,082 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:31,082 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:31,082 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:31,082 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-28 02:01:31,082 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:31,083 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:31,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-28 02:01:31,122 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-28 02:01:31,124 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 175 msec 2023-09-28 02:01:31,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-28 02:01:31,187 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-28 02:01:31,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-28 02:01:31,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-28 02:01:31,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-28 02:01:31,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-28 02:01:31,247 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 705) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_668700139_17 at /127.0.0.1:39142 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:33879 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:37059 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-204286443_1 at /127.0.0.1:42208 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-204286443_1 at /127.0.0.1:43596 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:43616 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:42252 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:40283 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 131) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=4586 (was 5398) 2023-09-28 02:01:31,247 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-28 02:01:31,266 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=932, MaxFileDescriptor=60000, SystemLoadAverage=209, ProcessCount=167, AvailableMemoryMB=4585 2023-09-28 02:01:31,266 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-28 02:01:31,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 02:01:31,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-28 02:01:31,273 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 02:01:31,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-28 02:01:31,275 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 02:01:31,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 02:01:31,278 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:31,278 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a 2023-09-28 02:01:31,278 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24 empty. 2023-09-28 02:01:31,278 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a empty. 2023-09-28 02:01:31,279 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:31,279 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a 2023-09-28 02:01:31,279 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-28 02:01:31,293 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-28 02:01:31,296 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => d35872be9ed3646694bf36b42b031b24, NAME => 'testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:01:31,297 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 87270edde2a7599702301934def2098a, NAME => 'testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:01:31,317 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:31,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 87270edde2a7599702301934def2098a, disabling compactions & flushes 2023-09-28 02:01:31,318 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:31,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:31,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. after waiting 0 ms 2023-09-28 02:01:31,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:31,318 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:31,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 87270edde2a7599702301934def2098a: 2023-09-28 02:01:31,318 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:31,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing d35872be9ed3646694bf36b42b031b24, disabling compactions & flushes 2023-09-28 02:01:31,319 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:31,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:31,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. after waiting 0 ms 2023-09-28 02:01:31,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:31,319 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:31,319 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for d35872be9ed3646694bf36b42b031b24: 2023-09-28 02:01:31,330 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 02:01:31,332 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866491332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866491332"}]},"ts":"1695866491332"} 2023-09-28 02:01:31,332 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866491332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866491332"}]},"ts":"1695866491332"} 2023-09-28 02:01:31,334 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 02:01:31,335 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 02:01:31,336 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866491336"}]},"ts":"1695866491336"} 2023-09-28 02:01:31,337 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-28 02:01:31,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 02:01:31,398 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:01:31,399 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:01:31,399 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:01:31,399 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:01:31,400 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:01:31,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d35872be9ed3646694bf36b42b031b24, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87270edde2a7599702301934def2098a, ASSIGN}] 2023-09-28 02:01:31,403 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d35872be9ed3646694bf36b42b031b24, ASSIGN 2023-09-28 02:01:31,403 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87270edde2a7599702301934def2098a, ASSIGN 2023-09-28 02:01:31,404 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d35872be9ed3646694bf36b42b031b24, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46883,1695866465849; forceNewPlan=false, retain=false 2023-09-28 02:01:31,404 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87270edde2a7599702301934def2098a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42313,1695866465812; forceNewPlan=false, retain=false 2023-09-28 02:01:31,554 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 02:01:31,557 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=d35872be9ed3646694bf36b42b031b24, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:31,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=87270edde2a7599702301934def2098a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:31,557 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866491557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866491557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866491557"}]},"ts":"1695866491557"} 2023-09-28 02:01:31,557 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866491557"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866491557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866491557"}]},"ts":"1695866491557"} 2023-09-28 02:01:31,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure d35872be9ed3646694bf36b42b031b24, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:01:31,562 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 87270edde2a7599702301934def2098a, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:01:31,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 02:01:31,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:31,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:31,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d35872be9ed3646694bf36b42b031b24, NAME => 'testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 02:01:31,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 87270edde2a7599702301934def2098a, NAME => 'testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 02:01:31,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. service=AccessControlService 2023-09-28 02:01:31,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. service=AccessControlService 2023-09-28 02:01:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:31,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 87270edde2a7599702301934def2098a 2023-09-28 02:01:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 87270edde2a7599702301934def2098a 2023-09-28 02:01:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 87270edde2a7599702301934def2098a 2023-09-28 02:01:31,721 INFO [StoreOpener-d35872be9ed3646694bf36b42b031b24-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:31,721 INFO [StoreOpener-87270edde2a7599702301934def2098a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 87270edde2a7599702301934def2098a 2023-09-28 02:01:31,722 DEBUG [StoreOpener-87270edde2a7599702301934def2098a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/cf 2023-09-28 02:01:31,722 DEBUG [StoreOpener-87270edde2a7599702301934def2098a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/cf 2023-09-28 02:01:31,723 DEBUG [StoreOpener-d35872be9ed3646694bf36b42b031b24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/cf 2023-09-28 02:01:31,723 DEBUG [StoreOpener-d35872be9ed3646694bf36b42b031b24-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/cf 2023-09-28 02:01:31,723 INFO [StoreOpener-87270edde2a7599702301934def2098a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 87270edde2a7599702301934def2098a columnFamilyName cf 2023-09-28 02:01:31,723 INFO [StoreOpener-d35872be9ed3646694bf36b42b031b24-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d35872be9ed3646694bf36b42b031b24 columnFamilyName cf 2023-09-28 02:01:31,725 INFO [StoreOpener-d35872be9ed3646694bf36b42b031b24-1] regionserver.HStore(310): Store=d35872be9ed3646694bf36b42b031b24/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:31,725 INFO [StoreOpener-87270edde2a7599702301934def2098a-1] regionserver.HStore(310): Store=87270edde2a7599702301934def2098a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:31,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:31,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a 2023-09-28 02:01:31,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:31,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a 2023-09-28 02:01:31,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:31,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 87270edde2a7599702301934def2098a 2023-09-28 02:01:31,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:31,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d35872be9ed3646694bf36b42b031b24; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73467159, jitterRate=0.09474597871303558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:01:31,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d35872be9ed3646694bf36b42b031b24: 2023-09-28 02:01:31,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24., pid=30, masterSystemTime=1695866491714 2023-09-28 02:01:31,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:31,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:31,738 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=d35872be9ed3646694bf36b42b031b24, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:31,738 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866491738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866491738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866491738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866491738"}]},"ts":"1695866491738"} 2023-09-28 02:01:31,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:31,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 87270edde2a7599702301934def2098a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66267932, jitterRate=-0.012530863285064697}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:01:31,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 87270edde2a7599702301934def2098a: 2023-09-28 02:01:31,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a., pid=31, masterSystemTime=1695866491714 2023-09-28 02:01:31,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:31,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:31,743 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-28 02:01:31,747 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=87270edde2a7599702301934def2098a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:31,747 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure d35872be9ed3646694bf36b42b031b24, server=jenkins-hbase4.apache.org,46883,1695866465849 in 180 msec 2023-09-28 02:01:31,747 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866491743"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866491743"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866491743"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866491743"}]},"ts":"1695866491743"} 2023-09-28 02:01:31,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d35872be9ed3646694bf36b42b031b24, ASSIGN in 347 msec 2023-09-28 02:01:31,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-28 02:01:31,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 87270edde2a7599702301934def2098a, server=jenkins-hbase4.apache.org,42313,1695866465812 in 187 msec 2023-09-28 02:01:31,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-28 02:01:31,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87270edde2a7599702301934def2098a, ASSIGN in 352 msec 2023-09-28 02:01:31,756 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 02:01:31,756 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866491756"}]},"ts":"1695866491756"} 2023-09-28 02:01:31,758 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-28 02:01:31,799 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 02:01:31,799 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-28 02:01:31,802 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 02:01:31,829 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:31,829 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:31,829 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:31,829 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:31,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 02:01:31,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:31,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:31,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:31,883 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:31,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 614 msec 2023-09-28 02:01:32,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-28 02:01:32,380 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-28 02:01:32,383 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-28 02:01:32,383 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:32,386 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:01:32,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:01:32,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866492402 (current time:1695866492402). 2023-09-28 02:01:32,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:01:32,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x37f49c07 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:32,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@794ab05d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:32,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:32,435 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:32,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37f49c07 to 127.0.0.1:56493 2023-09-28 02:01:32,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:32,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x5c8fcc5b to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:32,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f887769, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:32,501 DEBUG [hconnection-0x63ecee9d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:32,505 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:32,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c8fcc5b to 127.0.0.1:56493 2023-09-28 02:01:32,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:32,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 02:01:32,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:01:32,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:01:32,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:01:32,517 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:01:32,519 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695867092519 2023-09-28 02:01:32,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:01:32,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-28 02:01:32,522 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:01:32,522 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:01:32,524 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:01:32,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 02:01:32,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-09-28 02:01:32,531 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 02:01:32,533 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695867092533 2023-09-28 02:01:32,622 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:32,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 02:01:32,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:01:32,624 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:01:32,824 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:32,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 02:01:32,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:01:32,826 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-28 02:01:32,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,957 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-28 02:01:32,957 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:32,957 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-28 02:01:32,957 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-28 02:01:32,958 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,958 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,959 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:32,959 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:32,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:32,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:32,959 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:32,959 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:32,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:32,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,960 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:32,960 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,961 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:32,961 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,961 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 02:01:32,961 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 02:01:32,961 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:32,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,963 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 02:01:32,963 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 02:01:32,963 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:32,961 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 02:01:32,964 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 02:01:32,963 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 02:01:32,965 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 02:01:32,965 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 02:01:32,965 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 02:01:32,966 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-28 02:01:32,966 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-28 02:01:32,967 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:32,967 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:32,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:32,976 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:32,976 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:32,976 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,976 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:32,976 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,976 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,976 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:32,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:32,977 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,977 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:32,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:32,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:32,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-28 02:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cdab6dc[Count = 1] remaining members to acquire global barrier 2023-09-28 02:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:32,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:32,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:32,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:32,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-28 02:01:32,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cdab6dc[Count = 0] remaining members to acquire global barrier 2023-09-28 02:01:32,981 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 02:01:32,981 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,982 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,982 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,982 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:01:32,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:01:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:01:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 02:01:32,983 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:01:32,983 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:32,983 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. started... 2023-09-28 02:01:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:32,983 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:32,983 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:01:32,983 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:32,983 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:32,985 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. started... 2023-09-28 02:01:32,985 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87270edde2a7599702301934def2098a: 2023-09-28 02:01:32,985 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d35872be9ed3646694bf36b42b031b24: 2023-09-28 02:01:32,985 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,985 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:32,985 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:32,985 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:01:32,985 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:32,985 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:01:32,986 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 02:01:32,986 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:32,986 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 02:01:33,001 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. completed. 2023-09-28 02:01:33,001 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. completed. 2023-09-28 02:01:33,001 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:33,001 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:01:33,002 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:01:33,004 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 02:01:33,004 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,004 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:33,004 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:33,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:33,004 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 02:01:33,004 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 02:01:33,005 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:33,005 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-28 02:01:33,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:33,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:01:33,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 02:01:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:33,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:33,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:33,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:01:33,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 02:01:33,013 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-28 02:01:33,013 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:01:33,013 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:01:33,013 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,013 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:01:33,016 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:33,016 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,016 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:33,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,016 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,017 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:33,018 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:33,020 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,021 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,021 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:33,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:33,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:33,024 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:33,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:33,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:33,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:33,024 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:33,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:33,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,026 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-28 02:01:33,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:33,026 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:01:33,027 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,027 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,027 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,028 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,028 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,028 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 02:01:33,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,072 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-28 02:01:33,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,072 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:33,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695866492520Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695866493044 (+524 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695866493044Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695866493044Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695866493050 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695866493063 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695866493072 (+9 ms) 2023-09-28 02:01:33,075 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 02:01:33,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 554 msec 2023-09-28 02:01:33,126 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:33,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 02:01:33,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:01:33,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:01:33,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42313] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:01:33,138 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-28 02:01:33,138 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:33,139 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:01:33,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:01:33,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866493151 (current time:1695866493151). 2023-09-28 02:01:33,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:01:33,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x175cb553 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:33,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c908890, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:33,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:33,162 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:33,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x175cb553 to 127.0.0.1:56493 2023-09-28 02:01:33,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:33,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x58a6913b to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:33,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2de889d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:33,206 DEBUG [hconnection-0x183c2b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:33,209 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:33,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58a6913b to 127.0.0.1:56493 2023-09-28 02:01:33,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:33,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 02:01:33,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:01:33,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:01:33,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:01:33,220 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:01:33,221 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695867093221 2023-09-28 02:01:33,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-28 02:01:33,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:01:33,223 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:01:33,223 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:01:33,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 02:01:33,227 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:01:33,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-09-28 02:01:33,230 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 02:01:33,231 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695867093231 2023-09-28 02:01:33,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-28 02:01:33,252 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-28 02:01:33,252 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:33,254 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-28 02:01:33,254 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-28 02:01:33,254 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,254 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,256 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:33,256 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:33,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:33,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:33,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:33,256 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,256 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:33,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:33,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:33,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:33,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,256 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,257 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,257 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,257 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 02:01:33,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-28 02:01:33,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,258 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 02:01:33,258 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-28 02:01:33,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 02:01:33,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 02:01:33,258 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 02:01:33,258 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:33,258 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 02:01:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 02:01:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 02:01:33,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-28 02:01:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 02:01:33,260 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-28 02:01:33,260 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:33,259 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:33,261 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 02:01:33,262 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-28 02:01:33,262 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 02:01:33,262 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 02:01:33,262 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-28 02:01:33,262 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-28 02:01:33,263 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,263 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:33,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:33,266 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,266 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:33,266 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,266 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:33,266 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,267 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:33,267 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:33,267 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,267 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 02:01:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:33,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-28 02:01:33,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c8ddd21[Count = 1] remaining members to acquire global barrier 2023-09-28 02:01:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:33,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 02:01:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:33,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-28 02:01:33,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c8ddd21[Count = 0] remaining members to acquire global barrier 2023-09-28 02:01:33,270 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 02:01:33,270 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:01:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:01:33,272 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:01:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 02:01:33,272 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:01:33,273 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:33,273 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,273 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:01:33,273 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. started... 2023-09-28 02:01:33,273 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d35872be9ed3646694bf36b42b031b24 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-28 02:01:33,274 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 02:01:33,274 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:33,274 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 02:01:33,275 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:33,276 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:33,276 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:33,276 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. started... 2023-09-28 02:01:33,276 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 87270edde2a7599702301934def2098a 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-28 02:01:33,318 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928e52b73c9978649a6a258b0ae6b846188 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928e52b73c9978649a6a258b0ae6b846188 2023-09-28 02:01:33,318 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928484c512d627445e58b0be3285004665e to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928484c512d627445e58b0be3285004665e 2023-09-28 02:01:33,323 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:33,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 02:01:33,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:01:33,324 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:01:33,337 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/.tmp/cf/accf2cbdc1274134854875b019b371ef 2023-09-28 02:01:33,338 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/.tmp/cf/42bc90298ba84cb4a26a2f05650ffb97 2023-09-28 02:01:33,345 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/.tmp/cf/accf2cbdc1274134854875b019b371ef as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/cf/accf2cbdc1274134854875b019b371ef 2023-09-28 02:01:33,346 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/.tmp/cf/42bc90298ba84cb4a26a2f05650ffb97 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/cf/42bc90298ba84cb4a26a2f05650ffb97 2023-09-28 02:01:33,351 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/cf/accf2cbdc1274134854875b019b371ef, entries=45, sequenceid=6, filesize=12.5 K 2023-09-28 02:01:33,352 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 87270edde2a7599702301934def2098a in 76ms, sequenceid=6, compaction requested=false 2023-09-28 02:01:33,352 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-28 02:01:33,353 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 87270edde2a7599702301934def2098a: 2023-09-28 02:01:33,353 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 02:01:33,353 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:33,353 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/cf/accf2cbdc1274134854875b019b371ef] hfiles 2023-09-28 02:01:33,353 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/cf/accf2cbdc1274134854875b019b371ef for snapshot=snaptb0-testExportFileSystemState 2023-09-28 02:01:33,353 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/cf/42bc90298ba84cb4a26a2f05650ffb97, entries=5, sequenceid=6, filesize=5.7 K 2023-09-28 02:01:33,354 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for d35872be9ed3646694bf36b42b031b24 in 81ms, sequenceid=6, compaction requested=false 2023-09-28 02:01:33,356 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d35872be9ed3646694bf36b42b031b24: 2023-09-28 02:01:33,356 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 02:01:33,356 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:33,356 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/cf/42bc90298ba84cb4a26a2f05650ffb97] hfiles 2023-09-28 02:01:33,356 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/cf/42bc90298ba84cb4a26a2f05650ffb97 for snapshot=snaptb0-testExportFileSystemState 2023-09-28 02:01:33,368 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. completed. 2023-09-28 02:01:33,368 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:33,368 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:33,368 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:33,368 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,368 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 02:01:33,368 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:01:33,370 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. completed. 2023-09-28 02:01:33,371 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:33,371 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:33,371 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:33,371 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,371 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-28 02:01:33,371 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:01:33,376 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 02:01:33,377 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,377 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:33,377 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 02:01:33,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:33,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:33,379 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-28 02:01:33,379 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:33,379 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:33,379 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-28 02:01:33,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 02:01:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 02:01:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 02:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:33,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 02:01:33,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:33,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 02:01:33,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:01:33,387 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 02:01:33,387 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-28 02:01:33,387 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:01:33,387 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:01:33,387 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-28 02:01:33,387 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:01:33,388 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,388 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,388 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,388 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,388 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,388 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:33,389 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,389 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:33,389 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 02:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,390 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:33,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 02:01:33,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,392 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,392 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:33,393 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-28 02:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,396 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,396 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:33,396 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:33,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:33,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:33,396 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:33,396 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:33,397 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:33,397 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,397 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-28 02:01:33,397 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:33,397 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:33,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-28 02:01:33,397 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,399 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,399 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:33,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-28 02:01:33,399 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:01:33,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,399 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:33,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,399 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:33,399 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,399 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928e52b73c9978649a6a258b0ae6b846188, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928484c512d627445e58b0be3285004665e] mob files 2023-09-28 02:01:33,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:33,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928e52b73c9978649a6a258b0ae6b846188 2023-09-28 02:01:33,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:33,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928484c512d627445e58b0be3285004665e 2023-09-28 02:01:33,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-28 02:01:33,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,440 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-28 02:01:33,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,441 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695866493221Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695866493409 (+188 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695866493409Loading Region manifests for snaptb0-testExportFileSystemState at 1695866493409Writing data manifest for snaptb0-testExportFileSystemState at 1695866493418 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695866493427 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695866493440 (+13 ms) 2023-09-28 02:01:33,444 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-28 02:01:33,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 222 msec 2023-09-28 02:01:33,525 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:33,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 02:01:33,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:01:33,526 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526 2023-09-28 02:01:33,527 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35003, tgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526, rawTgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526, srcFsUri=hdfs://localhost:35003, srcDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:33,556 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:33,556 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1249891041_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,556 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d, snapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-28 02:01:33,572 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-28 02:01:33,604 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:33,605 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:33,605 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:33,606 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:34,497 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-6167686102037548637.jar 2023-09-28 02:01:34,497 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:34,498 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:34,575 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-1787588865371268757.jar 2023-09-28 02:01:34,575 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:34,576 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:34,576 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:34,577 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:34,577 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:34,577 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:34,578 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 02:01:34,578 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 02:01:34,578 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 02:01:34,579 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 02:01:34,579 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 02:01:34,580 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 02:01:34,580 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 02:01:34,580 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 02:01:34,581 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 02:01:34,581 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 02:01:34,582 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:34,582 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:34,583 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:01:34,583 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:34,583 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:34,584 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:01:34,584 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:01:34,862 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0001_000001 (auth:SIMPLE) 2023-09-28 02:01:35,509 WARN [Listener at jenkins-hbase4.apache.org/34629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 02:01:35,512 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-28 02:01:35,515 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-28 02:01:35,587 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:01:35,587 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:01:35,612 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0002_000001 (auth:SIMPLE) 2023-09-28 02:01:36,471 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 02:01:39,718 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0002_000001 (auth:SIMPLE) 2023-09-28 02:01:41,943 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0002_000001 (auth:SIMPLE) 2023-09-28 02:01:45,002 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0002_000001 (auth:SIMPLE) 2023-09-28 02:01:46,718 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 02:01:46,719 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 02:01:46,728 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-28 02:01:46,728 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 02:01:46,728 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 02:01:46,728 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 02:01:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-28 02:01:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-28 02:01:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-28 02:01:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-28 02:01:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866493526/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-28 02:01:46,736 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-28 02:01:46,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-28 02:01:46,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-28 02:01:46,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 02:01:46,743 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866506743"}]},"ts":"1695866506743"} 2023-09-28 02:01:46,744 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-28 02:01:46,746 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-28 02:01:46,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d35872be9ed3646694bf36b42b031b24, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87270edde2a7599702301934def2098a, UNASSIGN}] 2023-09-28 02:01:46,749 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d35872be9ed3646694bf36b42b031b24, UNASSIGN 2023-09-28 02:01:46,749 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87270edde2a7599702301934def2098a, UNASSIGN 2023-09-28 02:01:46,750 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d35872be9ed3646694bf36b42b031b24, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:46,750 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=87270edde2a7599702301934def2098a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:46,750 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866506750"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866506750"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866506750"}]},"ts":"1695866506750"} 2023-09-28 02:01:46,750 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866506750"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866506750"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866506750"}]},"ts":"1695866506750"} 2023-09-28 02:01:46,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 87270edde2a7599702301934def2098a, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:01:46,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure d35872be9ed3646694bf36b42b031b24, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:01:46,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 02:01:46,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 87270edde2a7599702301934def2098a 2023-09-28 02:01:46,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 87270edde2a7599702301934def2098a, disabling compactions & flushes 2023-09-28 02:01:46,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:46,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:46,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. after waiting 0 ms 2023-09-28 02:01:46,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:46,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:46,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d35872be9ed3646694bf36b42b031b24, disabling compactions & flushes 2023-09-28 02:01:46,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:46,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:46,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. after waiting 0 ms 2023-09-28 02:01:46,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:46,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:01:46,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:01:46,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:01:46,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:01:46,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a. 2023-09-28 02:01:46,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 87270edde2a7599702301934def2098a: 2023-09-28 02:01:46,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24. 2023-09-28 02:01:46,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d35872be9ed3646694bf36b42b031b24: 2023-09-28 02:01:46,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 87270edde2a7599702301934def2098a 2023-09-28 02:01:46,921 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=87270edde2a7599702301934def2098a, regionState=CLOSED 2023-09-28 02:01:46,921 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866506921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866506921"}]},"ts":"1695866506921"} 2023-09-28 02:01:46,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:46,922 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=d35872be9ed3646694bf36b42b031b24, regionState=CLOSED 2023-09-28 02:01:46,922 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695866506922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866506922"}]},"ts":"1695866506922"} 2023-09-28 02:01:46,925 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-28 02:01:46,925 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 87270edde2a7599702301934def2098a, server=jenkins-hbase4.apache.org,42313,1695866465812 in 171 msec 2023-09-28 02:01:46,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-28 02:01:46,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure d35872be9ed3646694bf36b42b031b24, server=jenkins-hbase4.apache.org,46883,1695866465849 in 171 msec 2023-09-28 02:01:46,927 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=87270edde2a7599702301934def2098a, UNASSIGN in 178 msec 2023-09-28 02:01:46,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-28 02:01:46,928 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=d35872be9ed3646694bf36b42b031b24, UNASSIGN in 179 msec 2023-09-28 02:01:46,929 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866506929"}]},"ts":"1695866506929"} 2023-09-28 02:01:46,930 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-28 02:01:46,931 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-28 02:01:46,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-28 02:01:47,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-28 02:01:47,045 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-28 02:01:47,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-28 02:01:47,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 02:01:47,049 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 02:01:47,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-28 02:01:47,050 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 02:01:47,054 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-28 02:01:47,055 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:47,055 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a 2023-09-28 02:01:47,057 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/recovered.edits] 2023-09-28 02:01:47,057 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/recovered.edits] 2023-09-28 02:01:47,058 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 02:01:47,058 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 02:01:47,058 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 02:01:47,058 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 02:01:47,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 02:01:47,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 02:01:47,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 02:01:47,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-28 02:01:47,060 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 02:01:47,060 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:47,060 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 02:01:47,060 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:47,060 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 02:01:47,060 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:47,060 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-28 02:01:47,060 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:47,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-28 02:01:47,063 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/cf/accf2cbdc1274134854875b019b371ef to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/cf/accf2cbdc1274134854875b019b371ef 2023-09-28 02:01:47,063 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/cf/42bc90298ba84cb4a26a2f05650ffb97 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/cf/42bc90298ba84cb4a26a2f05650ffb97 2023-09-28 02:01:47,066 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a/recovered.edits/9.seqid 2023-09-28 02:01:47,066 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24/recovered.edits/9.seqid 2023-09-28 02:01:47,067 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/87270edde2a7599702301934def2098a 2023-09-28 02:01:47,067 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemState/d35872be9ed3646694bf36b42b031b24 2023-09-28 02:01:47,067 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-28 02:01:47,068 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-28 02:01:47,068 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-28 02:01:47,072 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928e52b73c9978649a6a258b0ae6b846188 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230928e52b73c9978649a6a258b0ae6b846188 2023-09-28 02:01:47,073 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928484c512d627445e58b0be3285004665e to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230928484c512d627445e58b0be3285004665e 2023-09-28 02:01:47,073 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-28 02:01:47,076 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 02:01:47,078 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-28 02:01:47,081 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-28 02:01:47,082 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 02:01:47,082 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-28 02:01:47,082 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866507082"}]},"ts":"9223372036854775807"} 2023-09-28 02:01:47,082 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866507082"}]},"ts":"9223372036854775807"} 2023-09-28 02:01:47,084 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 02:01:47,085 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d35872be9ed3646694bf36b42b031b24, NAME => 'testtb-testExportFileSystemState,,1695866491268.d35872be9ed3646694bf36b42b031b24.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 87270edde2a7599702301934def2098a, NAME => 'testtb-testExportFileSystemState,1,1695866491268.87270edde2a7599702301934def2098a.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 02:01:47,085 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-28 02:01:47,085 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695866507085"}]},"ts":"9223372036854775807"} 2023-09-28 02:01:47,087 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-28 02:01:47,088 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-28 02:01:47,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 42 msec 2023-09-28 02:01:47,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-28 02:01:47,163 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-28 02:01:47,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-28 02:01:47,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-28 02:01:47,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-28 02:01:47,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-28 02:01:47,200 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=764 (was 754) Potentially hanging thread: hconnection-0x52070e30-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_337625349_1 at /127.0.0.1:45714 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2079 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x52070e30-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_337625349_1 at /127.0.0.1:55762 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:45984 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:46385 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:38800 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:59234 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:34629 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=934 (was 932) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 209) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=4516 (was 4585) 2023-09-28 02:01:47,200 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-28 02:01:47,218 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=764, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=211, ProcessCount=167, AvailableMemoryMB=4516 2023-09-28 02:01:47,218 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-28 02:01:47,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 02:01:47,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-28 02:01:47,224 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 02:01:47,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-28 02:01:47,224 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 02:01:47,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 02:01:47,227 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:01:47,227 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:01:47,228 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f empty. 2023-09-28 02:01:47,228 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9 empty. 2023-09-28 02:01:47,228 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:01:47,228 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:01:47,228 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-28 02:01:47,239 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-28 02:01:47,240 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 91fee8109140a4489d1c5713c149cb7f, NAME => 'testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:01:47,240 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => e10da35c0317743d2f6c05bff874e3d9, NAME => 'testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:01:47,261 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:47,262 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing e10da35c0317743d2f6c05bff874e3d9, disabling compactions & flushes 2023-09-28 02:01:47,262 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:47,262 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:47,262 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. after waiting 0 ms 2023-09-28 02:01:47,262 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:47,262 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:47,262 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for e10da35c0317743d2f6c05bff874e3d9: 2023-09-28 02:01:47,265 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:47,265 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 91fee8109140a4489d1c5713c149cb7f, disabling compactions & flushes 2023-09-28 02:01:47,266 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,266 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,266 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. after waiting 0 ms 2023-09-28 02:01:47,266 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,266 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,266 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 91fee8109140a4489d1c5713c149cb7f: 2023-09-28 02:01:47,268 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 02:01:47,269 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866507269"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866507269"}]},"ts":"1695866507269"} 2023-09-28 02:01:47,269 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866507269"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866507269"}]},"ts":"1695866507269"} 2023-09-28 02:01:47,272 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 02:01:47,273 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 02:01:47,273 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866507273"}]},"ts":"1695866507273"} 2023-09-28 02:01:47,274 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-28 02:01:47,278 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:01:47,279 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:01:47,279 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:01:47,279 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:01:47,279 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:01:47,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91fee8109140a4489d1c5713c149cb7f, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e10da35c0317743d2f6c05bff874e3d9, ASSIGN}] 2023-09-28 02:01:47,284 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e10da35c0317743d2f6c05bff874e3d9, ASSIGN 2023-09-28 02:01:47,284 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91fee8109140a4489d1c5713c149cb7f, ASSIGN 2023-09-28 02:01:47,285 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91fee8109140a4489d1c5713c149cb7f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46883,1695866465849; forceNewPlan=false, retain=false 2023-09-28 02:01:47,285 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e10da35c0317743d2f6c05bff874e3d9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42313,1695866465812; forceNewPlan=false, retain=false 2023-09-28 02:01:47,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 02:01:47,435 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 02:01:47,438 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=91fee8109140a4489d1c5713c149cb7f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,438 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=e10da35c0317743d2f6c05bff874e3d9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,438 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866507438"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866507438"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866507438"}]},"ts":"1695866507438"} 2023-09-28 02:01:47,438 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866507438"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866507438"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866507438"}]},"ts":"1695866507438"} 2023-09-28 02:01:47,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 91fee8109140a4489d1c5713c149cb7f, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:01:47,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure e10da35c0317743d2f6c05bff874e3d9, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:01:47,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 02:01:47,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91fee8109140a4489d1c5713c149cb7f, NAME => 'testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 02:01:47,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. service=AccessControlService 2023-09-28 02:01:47,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:47,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:01:47,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:47,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:47,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:01:47,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e10da35c0317743d2f6c05bff874e3d9, NAME => 'testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 02:01:47,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:01:47,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. service=AccessControlService 2023-09-28 02:01:47,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:01:47,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:01:47,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:01:47,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:01:47,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:01:47,598 INFO [StoreOpener-91fee8109140a4489d1c5713c149cb7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:01:47,598 INFO [StoreOpener-e10da35c0317743d2f6c05bff874e3d9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:01:47,599 DEBUG [StoreOpener-91fee8109140a4489d1c5713c149cb7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/cf 2023-09-28 02:01:47,599 DEBUG [StoreOpener-91fee8109140a4489d1c5713c149cb7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/cf 2023-09-28 02:01:47,600 INFO [StoreOpener-91fee8109140a4489d1c5713c149cb7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91fee8109140a4489d1c5713c149cb7f columnFamilyName cf 2023-09-28 02:01:47,600 DEBUG [StoreOpener-e10da35c0317743d2f6c05bff874e3d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/cf 2023-09-28 02:01:47,600 DEBUG [StoreOpener-e10da35c0317743d2f6c05bff874e3d9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/cf 2023-09-28 02:01:47,600 INFO [StoreOpener-e10da35c0317743d2f6c05bff874e3d9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e10da35c0317743d2f6c05bff874e3d9 columnFamilyName cf 2023-09-28 02:01:47,601 INFO [StoreOpener-91fee8109140a4489d1c5713c149cb7f-1] regionserver.HStore(310): Store=91fee8109140a4489d1c5713c149cb7f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:47,601 INFO [StoreOpener-e10da35c0317743d2f6c05bff874e3d9-1] regionserver.HStore(310): Store=e10da35c0317743d2f6c05bff874e3d9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:01:47,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:01:47,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:01:47,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:01:47,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:01:47,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:01:47,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:01:47,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:47,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:01:47,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e10da35c0317743d2f6c05bff874e3d9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59188688, jitterRate=-0.11801981925964355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:01:47,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91fee8109140a4489d1c5713c149cb7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71028092, jitterRate=0.05840104818344116}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:01:47,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e10da35c0317743d2f6c05bff874e3d9: 2023-09-28 02:01:47,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91fee8109140a4489d1c5713c149cb7f: 2023-09-28 02:01:47,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f., pid=45, masterSystemTime=1695866507592 2023-09-28 02:01:47,610 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9., pid=46, masterSystemTime=1695866507593 2023-09-28 02:01:47,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,613 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=91fee8109140a4489d1c5713c149cb7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:47,613 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866507613"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866507613"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866507613"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866507613"}]},"ts":"1695866507613"} 2023-09-28 02:01:47,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:47,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=e10da35c0317743d2f6c05bff874e3d9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,614 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866507613"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866507613"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866507613"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866507613"}]},"ts":"1695866507613"} 2023-09-28 02:01:47,616 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-28 02:01:47,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 91fee8109140a4489d1c5713c149cb7f, server=jenkins-hbase4.apache.org,46883,1695866465849 in 175 msec 2023-09-28 02:01:47,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-28 02:01:47,617 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure e10da35c0317743d2f6c05bff874e3d9, server=jenkins-hbase4.apache.org,42313,1695866465812 in 174 msec 2023-09-28 02:01:47,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91fee8109140a4489d1c5713c149cb7f, ASSIGN in 337 msec 2023-09-28 02:01:47,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-28 02:01:47,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e10da35c0317743d2f6c05bff874e3d9, ASSIGN in 338 msec 2023-09-28 02:01:47,620 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 02:01:47,620 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866507620"}]},"ts":"1695866507620"} 2023-09-28 02:01:47,621 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-28 02:01:47,623 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 02:01:47,624 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-28 02:01:47,625 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 02:01:47,627 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:47,627 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:47,627 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:47,627 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:01:47,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:47,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:47,628 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:47,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-28 02:01:47,630 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 408 msec 2023-09-28 02:01:47,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-28 02:01:47,829 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-28 02:01:47,832 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-28 02:01:47,832 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,834 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:01:47,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 02:01:47,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866507846 (current time:1695866507846). 2023-09-28 02:01:47,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:01:47,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x674bd45b to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:47,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cecf0fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:47,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:47,859 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:47,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x674bd45b to 127.0.0.1:56493 2023-09-28 02:01:47,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:47,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x5078db06 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:47,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69a8245e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:47,867 DEBUG [hconnection-0x72584a8e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:47,868 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:47,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5078db06 to 127.0.0.1:56493 2023-09-28 02:01:47,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:47,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 02:01:47,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:01:47,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 02:01:47,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 02:01:47,877 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 02:01:47,877 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695867107877 2023-09-28 02:01:47,877 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-28 02:01:47,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 02:01:47,879 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:01:47,879 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:01:47,880 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 02:01:47,880 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 02:01:47,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-28 02:01:47,882 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 02:01:47,882 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695867107882 2023-09-28 02:01:47,893 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,893 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-28 02:01:47,893 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:47,894 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-28 02:01:47,894 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-28 02:01:47,895 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,895 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,897 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:47,897 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:47,897 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:47,897 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:47,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:47,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:47,897 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,897 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:47,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,898 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,898 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:01:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 02:01:47,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,899 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 02:01:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 02:01:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-28 02:01:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,899 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 02:01:47,899 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 02:01:47,899 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 02:01:47,899 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:47,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,900 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 02:01:47,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,900 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 02:01:47,901 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 02:01:47,901 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:47,900 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 02:01:47,902 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 02:01:47,902 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 02:01:47,901 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:47,902 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 02:01:47,905 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 02:01:47,905 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-28 02:01:47,902 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 02:01:47,905 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-28 02:01:47,906 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,906 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,906 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,906 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:47,906 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:47,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:47,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,907 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:47,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:47,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:47,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-28 02:01:47,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b806317[Count = 1] remaining members to acquire global barrier 2023-09-28 02:01:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:47,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:47,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-28 02:01:47,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b806317[Count = 0] remaining members to acquire global barrier 2023-09-28 02:01:47,912 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-28 02:01:47,912 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,913 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,913 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,913 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,913 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 02:01:47,913 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,913 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 02:01:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 02:01:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 02:01:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:01:47,914 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,914 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:01:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:47,914 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:47,914 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:47,914 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. started... 2023-09-28 02:01:47,914 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:47,914 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. started... 2023-09-28 02:01:47,914 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91fee8109140a4489d1c5713c149cb7f: 2023-09-28 02:01:47,915 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e10da35c0317743d2f6c05bff874e3d9: 2023-09-28 02:01:47,916 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,916 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,916 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:47,917 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:47,917 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:01:47,917 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:01:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 02:01:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:47,923 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 02:01:47,930 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. completed. 2023-09-28 02:01:47,930 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 02:01:47,930 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:01:47,931 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. completed. 2023-09-28 02:01:47,931 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:47,931 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:47,931 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:47,931 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,931 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-28 02:01:47,931 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:01:47,932 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 02:01:47,932 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,932 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:47,932 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 02:01:47,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:47,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:47,934 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,934 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 02:01:47,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:47,934 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:47,934 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-28 02:01:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:47,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-28 02:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:47,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:01:47,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-28 02:01:47,941 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-28 02:01:47,941 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:01:47,941 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:01:47,941 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,941 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:01:47,942 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,942 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,943 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,942 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:47,943 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:47,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,943 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,943 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,943 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:47,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:47,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:47,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:47,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,944 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:47,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,944 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:47,946 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,947 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,947 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,951 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,951 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:47,951 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:47,951 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:47,951 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,951 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:47,951 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,951 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:47,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:47,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:47,951 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:47,952 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:47,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:47,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,952 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:47,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:47,953 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-28 02:01:47,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:47,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,953 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:47,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:01:47,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:47,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:47,954 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,954 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:47,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:47,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:47,954 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:47,954 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,954 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 02:01:47,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,979 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:47,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 02:01:47,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:01:47,981 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:01:47,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,993 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-28 02:01:47,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,993 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-28 02:01:47,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695866507878Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695866507965 (+87 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695866507965Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695866507965Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695866507970 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695866507986 (+16 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695866507993 (+7 ms) 2023-09-28 02:01:47,996 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 02:01:47,998 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 118 msec 2023-09-28 02:01:48,181 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:48,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 02:01:48,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:01:48,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46883] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:01:48,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42313] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:01:48,189 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-28 02:01:48,189 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:48,190 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:01:48,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 02:01:48,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866508203 (current time:1695866508203). 2023-09-28 02:01:48,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:01:48,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x123d0480 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:48,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@335f471c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:48,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:48,220 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:48,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x123d0480 to 127.0.0.1:56493 2023-09-28 02:01:48,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:48,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x6220d89c to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:01:48,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18c3c95c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:01:48,229 DEBUG [hconnection-0x516d1aff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:01:48,232 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:01:48,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6220d89c to 127.0.0.1:56493 2023-09-28 02:01:48,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:01:48,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-28 02:01:48,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:01:48,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 02:01:48,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 02:01:48,244 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 02:01:48,245 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695867108245 2023-09-28 02:01:48,245 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-28 02:01:48,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-28 02:01:48,246 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:01:48,246 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:01:48,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 02:01:48,247 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-28 02:01:48,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-09-28 02:01:48,249 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 02:01:48,250 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695867108250 2023-09-28 02:01:48,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-28 02:01:48,260 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-28 02:01:48,260 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:48,261 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-28 02:01:48,261 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-28 02:01:48,262 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,262 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,263 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,263 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:48,263 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:48,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:48,263 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:48,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:48,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:48,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:48,264 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,264 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,264 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,264 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:01:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,264 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 02:01:48,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 02:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 02:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-28 02:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 02:01:48,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 02:01:48,265 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-28 02:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 02:01:48,265 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:48,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 02:01:48,266 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 02:01:48,266 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 02:01:48,266 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:48,266 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 02:01:48,267 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 02:01:48,267 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 02:01:48,267 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 02:01:48,266 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-28 02:01:48,267 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 02:01:48,268 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-28 02:01:48,268 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:01:48,268 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-28 02:01:48,268 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-28 02:01:48,269 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-28 02:01:48,270 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,270 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:48,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:48,270 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,270 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,271 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,271 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:48,271 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:48,271 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,271 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:48,271 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:48,271 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:01:48,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 02:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-28 02:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44112cd3[Count = 1] remaining members to acquire global barrier 2023-09-28 02:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:48,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:48,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 02:01:48,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:48,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-28 02:01:48,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44112cd3[Count = 0] remaining members to acquire global barrier 2023-09-28 02:01:48,275 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-28 02:01:48,275 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 02:01:48,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 02:01:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-28 02:01:48,277 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,277 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:01:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:48,278 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:01:48,278 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:48,277 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:48,278 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. started... 2023-09-28 02:01:48,278 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. started... 2023-09-28 02:01:48,277 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 02:01:48,278 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:48,278 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 91fee8109140a4489d1c5713c149cb7f 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-28 02:01:48,278 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:01:48,278 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e10da35c0317743d2f6c05bff874e3d9 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-28 02:01:48,278 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:01:48,280 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 02:01:48,280 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:48,280 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 02:01:48,314 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230928b461eb0158ee4f7db10c54e9a3f46c87 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928b461eb0158ee4f7db10c54e9a3f46c87 2023-09-28 02:01:48,316 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928075ec344912e4ad38c6193defd4ae7bf to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928075ec344912e4ad38c6193defd4ae7bf 2023-09-28 02:01:48,329 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/.tmp/cf/f495a4acb5ca4a5d8cf7e1823d852da6 2023-09-28 02:01:48,330 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/.tmp/cf/2d5a0fb0d1fd46998b50e76bc2571c57 2023-09-28 02:01:48,335 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/.tmp/cf/2d5a0fb0d1fd46998b50e76bc2571c57 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/cf/2d5a0fb0d1fd46998b50e76bc2571c57 2023-09-28 02:01:48,335 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/.tmp/cf/f495a4acb5ca4a5d8cf7e1823d852da6 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/cf/f495a4acb5ca4a5d8cf7e1823d852da6 2023-09-28 02:01:48,340 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/cf/2d5a0fb0d1fd46998b50e76bc2571c57, entries=2, sequenceid=6, filesize=5.2 K 2023-09-28 02:01:48,341 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/cf/f495a4acb5ca4a5d8cf7e1823d852da6, entries=48, sequenceid=6, filesize=12.9 K 2023-09-28 02:01:48,341 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 91fee8109140a4489d1c5713c149cb7f in 63ms, sequenceid=6, compaction requested=false 2023-09-28 02:01:48,342 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-28 02:01:48,342 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for e10da35c0317743d2f6c05bff874e3d9 in 64ms, sequenceid=6, compaction requested=false 2023-09-28 02:01:48,342 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91fee8109140a4489d1c5713c149cb7f: 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e10da35c0317743d2f6c05bff874e3d9: 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/cf/2d5a0fb0d1fd46998b50e76bc2571c57] hfiles 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/cf/f495a4acb5ca4a5d8cf7e1823d852da6] hfiles 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/cf/2d5a0fb0d1fd46998b50e76bc2571c57 for snapshot=snaptb0-testConsecutiveExports 2023-09-28 02:01:48,344 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/cf/f495a4acb5ca4a5d8cf7e1823d852da6 for snapshot=snaptb0-testConsecutiveExports 2023-09-28 02:01:48,347 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:48,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 02:01:48,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:01:48,348 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:01:48,353 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. completed. 2023-09-28 02:01:48,353 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:01:48,353 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:48,353 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:48,353 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,353 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 02:01:48,353 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:01:48,353 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. completed. 2023-09-28 02:01:48,353 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:01:48,353 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:01:48,353 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:01:48,354 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,354 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-28 02:01:48,354 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:01:48,355 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,355 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 02:01:48,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:48,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:48,355 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:48,355 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 02:01:48,357 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,357 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-28 02:01:48,357 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:48,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:48,357 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-28 02:01:48,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:48,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 02:01:48,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:48,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 02:01:48,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:01:48,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-28 02:01:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:48,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:48,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 02:01:48,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 02:01:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:01:48,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-28 02:01:48,365 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-28 02:01:48,365 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:01:48,365 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:01:48,366 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-28 02:01:48,366 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:01:48,369 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:01:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:01:48,369 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:48,369 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:48,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:48,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,369 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:01:48,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:48,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:48,370 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:48,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 02:01:48,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,371 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:01:48,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 02:01:48,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,373 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:01:48,374 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-28 02:01:48,374 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,380 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:48,381 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,381 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,381 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,381 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,381 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,381 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:01:48,381 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:01:48,381 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:48,380 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:01:48,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:48,382 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:48,381 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,381 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-28 02:01:48,381 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:48,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:48,383 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-28 02:01:48,383 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:01:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:48,383 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:01:48,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:01:48,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-28 02:01:48,383 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:01:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:48,383 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:01:48,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:01:48,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:48,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:48,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:48,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:48,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:01:48,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:01:48,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928b461eb0158ee4f7db10c54e9a3f46c87, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928075ec344912e4ad38c6193defd4ae7bf] mob files 2023-09-28 02:01:48,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928b461eb0158ee4f7db10c54e9a3f46c87 2023-09-28 02:01:48,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928075ec344912e4ad38c6193defd4ae7bf 2023-09-28 02:01:48,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-28 02:01:48,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,417 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,418 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-28 02:01:48,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,418 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695866508245Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695866508396 (+151 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695866508396Loading Region manifests for snaptb0-testConsecutiveExports at 1695866508396Writing data manifest for snaptb0-testConsecutiveExports at 1695866508400 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695866508410 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695866508418 (+8 ms) 2023-09-28 02:01:48,421 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-28 02:01:48,423 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 175 msec 2023-09-28 02:01:48,548 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:01:48,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-28 02:01:48,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:01:48,550 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550 2023-09-28 02:01:48,550 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550, srcFsUri=hdfs://localhost:35003, srcDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:48,572 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:01:48,572 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3a21a3c7, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,572 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d, snapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-28 02:01:48,580 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 02:01:48,593 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:48,593 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:48,593 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:48,594 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:49,472 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-5751337835646992584.jar 2023-09-28 02:01:49,472 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:49,473 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:49,539 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-485652051567283265.jar 2023-09-28 02:01:49,540 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:49,540 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:49,541 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:49,541 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:49,541 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:49,542 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 02:01:49,542 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 02:01:49,542 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 02:01:49,543 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 02:01:49,543 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 02:01:49,544 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 02:01:49,544 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 02:01:49,545 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 02:01:49,546 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 02:01:49,546 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 02:01:49,547 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 02:01:49,548 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:49,548 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:49,549 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:01:49,550 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:49,550 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:01:49,551 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:01:49,552 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:01:49,965 WARN [Listener at jenkins-hbase4.apache.org/34629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 02:01:49,968 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-28 02:01:49,970 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-28 02:01:51,171 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:01:51,171 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:01:51,175 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0002_000001 (auth:SIMPLE) 2023-09-28 02:01:51,991 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0003_000001 (auth:SIMPLE) 2023-09-28 02:01:52,497 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 02:01:55,765 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0003_000001 (auth:SIMPLE) 2023-09-28 02:01:57,989 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0003_000001 (auth:SIMPLE) 2023-09-28 02:02:00,370 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0003_000001 (auth:SIMPLE) 2023-09-28 02:02:02,135 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 02:02:02,135 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 02:02:02,139 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-28 02:02:02,139 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 02:02:02,140 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 02:02:02,140 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 02:02:02,143 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 02:02:02,143 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 02:02:02,143 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1e3249e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 02:02:02,143 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 02:02:02,143 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 02:02:02,144 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550, srcFsUri=hdfs://localhost:35003, srcDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:02:02,166 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:02:02,167 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@544c5892, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 02:02:02,167 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d, snapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-28 02:02:02,178 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-28 02:02:02,190 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:02,190 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:02,190 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:02,191 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:03,064 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-6539751800514927403.jar 2023-09-28 02:02:03,065 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:03,065 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:03,131 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-1777923256349187597.jar 2023-09-28 02:02:03,132 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:03,132 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:03,133 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:03,133 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:03,133 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:03,134 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:03,134 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 02:02:03,134 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 02:02:03,135 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 02:02:03,135 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 02:02:03,135 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 02:02:03,136 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 02:02:03,136 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 02:02:03,137 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 02:02:03,137 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 02:02:03,137 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 02:02:03,138 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:03,138 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:03,139 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:03,139 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:03,139 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:03,140 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:03,140 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:03,508 WARN [Listener at jenkins-hbase4.apache.org/34629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 02:02:03,510 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-28 02:02:03,512 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-28 02:02:06,543 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:02:06,543 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:02:06,545 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0003_000001 (auth:SIMPLE) 2023-09-28 02:02:07,186 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0004_000001 (auth:SIMPLE) 2023-09-28 02:02:10,932 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0004_000001 (auth:SIMPLE) 2023-09-28 02:02:13,147 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0004_000001 (auth:SIMPLE) 2023-09-28 02:02:15,389 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0004_000001 (auth:SIMPLE) 2023-09-28 02:02:16,672 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 02:02:16,672 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 02:02:16,675 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-28 02:02:16,676 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 02:02:16,676 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 02:02:16,676 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 02:02:16,679 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 02:02:16,679 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 02:02:16,679 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1e3249e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-28 02:02:16,679 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-28 02:02:16,679 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/local-export-1695866508550/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-28 02:02:16,691 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-28 02:02:16,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-28 02:02:16,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-28 02:02:16,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 02:02:16,696 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866536696"}]},"ts":"1695866536696"} 2023-09-28 02:02:16,698 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-28 02:02:16,699 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-28 02:02:16,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91fee8109140a4489d1c5713c149cb7f, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e10da35c0317743d2f6c05bff874e3d9, UNASSIGN}] 2023-09-28 02:02:16,702 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e10da35c0317743d2f6c05bff874e3d9, UNASSIGN 2023-09-28 02:02:16,702 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91fee8109140a4489d1c5713c149cb7f, UNASSIGN 2023-09-28 02:02:16,703 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=e10da35c0317743d2f6c05bff874e3d9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:16,703 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=91fee8109140a4489d1c5713c149cb7f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:16,703 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866536703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866536703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866536703"}]},"ts":"1695866536703"} 2023-09-28 02:02:16,703 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866536703"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866536703"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866536703"}]},"ts":"1695866536703"} 2023-09-28 02:02:16,704 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure e10da35c0317743d2f6c05bff874e3d9, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:02:16,705 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 91fee8109140a4489d1c5713c149cb7f, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:02:16,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 02:02:16,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:02:16,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e10da35c0317743d2f6c05bff874e3d9, disabling compactions & flushes 2023-09-28 02:02:16,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:02:16,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:02:16,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. after waiting 0 ms 2023-09-28 02:02:16,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:02:16,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:02:16,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91fee8109140a4489d1c5713c149cb7f, disabling compactions & flushes 2023-09-28 02:02:16,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:02:16,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:02:16,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. after waiting 0 ms 2023-09-28 02:02:16,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:02:16,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:02:16,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:02:16,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:16,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:16,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f. 2023-09-28 02:02:16,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9. 2023-09-28 02:02:16,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91fee8109140a4489d1c5713c149cb7f: 2023-09-28 02:02:16,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e10da35c0317743d2f6c05bff874e3d9: 2023-09-28 02:02:16,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:02:16,872 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=91fee8109140a4489d1c5713c149cb7f, regionState=CLOSED 2023-09-28 02:02:16,872 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866536872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866536872"}]},"ts":"1695866536872"} 2023-09-28 02:02:16,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:02:16,872 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=e10da35c0317743d2f6c05bff874e3d9, regionState=CLOSED 2023-09-28 02:02:16,872 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695866536872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866536872"}]},"ts":"1695866536872"} 2023-09-28 02:02:16,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-28 02:02:16,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 91fee8109140a4489d1c5713c149cb7f, server=jenkins-hbase4.apache.org,46883,1695866465849 in 168 msec 2023-09-28 02:02:16,876 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-28 02:02:16,876 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure e10da35c0317743d2f6c05bff874e3d9, server=jenkins-hbase4.apache.org,42313,1695866465812 in 170 msec 2023-09-28 02:02:16,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=91fee8109140a4489d1c5713c149cb7f, UNASSIGN in 175 msec 2023-09-28 02:02:16,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-28 02:02:16,878 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e10da35c0317743d2f6c05bff874e3d9, UNASSIGN in 176 msec 2023-09-28 02:02:16,879 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866536879"}]},"ts":"1695866536879"} 2023-09-28 02:02:16,880 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-28 02:02:16,882 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-28 02:02:16,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 191 msec 2023-09-28 02:02:16,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-28 02:02:16,998 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-28 02:02:16,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-28 02:02:17,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 02:02:17,002 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 02:02:17,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-28 02:02:17,003 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 02:02:17,006 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-28 02:02:17,009 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:02:17,009 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:02:17,009 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 02:02:17,010 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 02:02:17,010 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 02:02:17,010 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 02:02:17,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 02:02:17,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 02:02:17,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 02:02:17,010 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-28 02:02:17,011 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 02:02:17,011 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 02:02:17,011 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/recovered.edits] 2023-09-28 02:02:17,011 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 02:02:17,011 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:17,011 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:17,011 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-28 02:02:17,012 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:17,012 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/recovered.edits] 2023-09-28 02:02:17,012 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:17,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-28 02:02:17,016 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/cf/2d5a0fb0d1fd46998b50e76bc2571c57 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/cf/2d5a0fb0d1fd46998b50e76bc2571c57 2023-09-28 02:02:17,016 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/cf/f495a4acb5ca4a5d8cf7e1823d852da6 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/cf/f495a4acb5ca4a5d8cf7e1823d852da6 2023-09-28 02:02:17,019 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f/recovered.edits/9.seqid 2023-09-28 02:02:17,019 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9/recovered.edits/9.seqid 2023-09-28 02:02:17,019 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/91fee8109140a4489d1c5713c149cb7f 2023-09-28 02:02:17,020 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testConsecutiveExports/e10da35c0317743d2f6c05bff874e3d9 2023-09-28 02:02:17,020 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-28 02:02:17,020 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-28 02:02:17,021 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-28 02:02:17,024 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928b461eb0158ee4f7db10c54e9a3f46c87 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230928b461eb0158ee4f7db10c54e9a3f46c87 2023-09-28 02:02:17,025 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928075ec344912e4ad38c6193defd4ae7bf to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230928075ec344912e4ad38c6193defd4ae7bf 2023-09-28 02:02:17,026 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-28 02:02:17,028 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 02:02:17,030 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-28 02:02:17,032 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-28 02:02:17,034 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 02:02:17,034 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-28 02:02:17,034 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866537034"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:17,034 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866537034"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:17,036 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 02:02:17,036 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 91fee8109140a4489d1c5713c149cb7f, NAME => 'testtb-testConsecutiveExports,,1695866507220.91fee8109140a4489d1c5713c149cb7f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e10da35c0317743d2f6c05bff874e3d9, NAME => 'testtb-testConsecutiveExports,1,1695866507220.e10da35c0317743d2f6c05bff874e3d9.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 02:02:17,036 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-28 02:02:17,036 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695866537036"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:17,038 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-28 02:02:17,040 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-28 02:02:17,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 41 msec 2023-09-28 02:02:17,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-28 02:02:17,114 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-28 02:02:17,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-28 02:02:17,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-28 02:02:17,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-28 02:02:17,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-28 02:02:17,153 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 764), OpenFileDescriptor=900 (was 934), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=128 (was 211), ProcessCount=168 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=4243 (was 4516) 2023-09-28 02:02:17,153 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-28 02:02:17,171 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=128, ProcessCount=168, AvailableMemoryMB=4243 2023-09-28 02:02:17,172 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-09-28 02:02:17,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 02:02:17,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,177 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 02:02:17,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-28 02:02:17,178 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 02:02:17,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 02:02:17,180 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:17,180 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:17,181 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8 empty. 2023-09-28 02:02:17,181 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e empty. 2023-09-28 02:02:17,181 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:17,182 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:17,182 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-28 02:02:17,194 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-28 02:02:17,195 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => e14ad58a99f57bfe652af4af6d6891a8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:02:17,195 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => eb9a86d6902b5573394e4afc96d76d7e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:02:17,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:17,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing eb9a86d6902b5573394e4afc96d76d7e, disabling compactions & flushes 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing e14ad58a99f57bfe652af4af6d6891a8, disabling compactions & flushes 2023-09-28 02:02:17,212 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:17,212 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. after waiting 0 ms 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. after waiting 0 ms 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,212 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:17,212 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for eb9a86d6902b5573394e4afc96d76d7e: 2023-09-28 02:02:17,212 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for e14ad58a99f57bfe652af4af6d6891a8: 2023-09-28 02:02:17,215 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 02:02:17,215 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866537215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866537215"}]},"ts":"1695866537215"} 2023-09-28 02:02:17,216 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866537215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866537215"}]},"ts":"1695866537215"} 2023-09-28 02:02:17,221 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 02:02:17,222 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 02:02:17,222 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866537222"}]},"ts":"1695866537222"} 2023-09-28 02:02:17,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-28 02:02:17,227 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:02:17,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:02:17,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:02:17,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:02:17,228 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:02:17,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e14ad58a99f57bfe652af4af6d6891a8, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=eb9a86d6902b5573394e4afc96d76d7e, ASSIGN}] 2023-09-28 02:02:17,231 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=eb9a86d6902b5573394e4afc96d76d7e, ASSIGN 2023-09-28 02:02:17,231 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e14ad58a99f57bfe652af4af6d6891a8, ASSIGN 2023-09-28 02:02:17,231 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=eb9a86d6902b5573394e4afc96d76d7e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42313,1695866465812; forceNewPlan=false, retain=false 2023-09-28 02:02:17,231 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e14ad58a99f57bfe652af4af6d6891a8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46883,1695866465849; forceNewPlan=false, retain=false 2023-09-28 02:02:17,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 02:02:17,382 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 02:02:17,384 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=eb9a86d6902b5573394e4afc96d76d7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,384 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e14ad58a99f57bfe652af4af6d6891a8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,384 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866537384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866537384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866537384"}]},"ts":"1695866537384"} 2023-09-28 02:02:17,385 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866537384"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866537384"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866537384"}]},"ts":"1695866537384"} 2023-09-28 02:02:17,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure eb9a86d6902b5573394e4afc96d76d7e, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:02:17,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure e14ad58a99f57bfe652af4af6d6891a8, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:02:17,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 02:02:17,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:17,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e14ad58a99f57bfe652af4af6d6891a8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 02:02:17,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb9a86d6902b5573394e4afc96d76d7e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 02:02:17,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. service=AccessControlService 2023-09-28 02:02:17,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. service=AccessControlService 2023-09-28 02:02:17,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:02:17,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:17,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:02:17,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:17,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:17,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:17,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:17,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:17,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:17,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:17,544 INFO [StoreOpener-eb9a86d6902b5573394e4afc96d76d7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:17,544 INFO [StoreOpener-e14ad58a99f57bfe652af4af6d6891a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:17,546 DEBUG [StoreOpener-eb9a86d6902b5573394e4afc96d76d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/cf 2023-09-28 02:02:17,546 DEBUG [StoreOpener-e14ad58a99f57bfe652af4af6d6891a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/cf 2023-09-28 02:02:17,546 DEBUG [StoreOpener-e14ad58a99f57bfe652af4af6d6891a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/cf 2023-09-28 02:02:17,546 DEBUG [StoreOpener-eb9a86d6902b5573394e4afc96d76d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/cf 2023-09-28 02:02:17,547 INFO [StoreOpener-eb9a86d6902b5573394e4afc96d76d7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb9a86d6902b5573394e4afc96d76d7e columnFamilyName cf 2023-09-28 02:02:17,547 INFO [StoreOpener-e14ad58a99f57bfe652af4af6d6891a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e14ad58a99f57bfe652af4af6d6891a8 columnFamilyName cf 2023-09-28 02:02:17,548 INFO [StoreOpener-eb9a86d6902b5573394e4afc96d76d7e-1] regionserver.HStore(310): Store=eb9a86d6902b5573394e4afc96d76d7e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:02:17,548 INFO [StoreOpener-e14ad58a99f57bfe652af4af6d6891a8-1] regionserver.HStore(310): Store=e14ad58a99f57bfe652af4af6d6891a8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:02:17,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:17,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:17,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:17,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:17,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:17,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:17,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:02:17,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:02:17,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e14ad58a99f57bfe652af4af6d6891a8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73915311, jitterRate=0.1014239639043808}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:02:17,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e14ad58a99f57bfe652af4af6d6891a8: 2023-09-28 02:02:17,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eb9a86d6902b5573394e4afc96d76d7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63253630, jitterRate=-0.057447463274002075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:02:17,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eb9a86d6902b5573394e4afc96d76d7e: 2023-09-28 02:02:17,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8., pid=61, masterSystemTime=1695866537538 2023-09-28 02:02:17,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e., pid=60, masterSystemTime=1695866537538 2023-09-28 02:02:17,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,559 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e14ad58a99f57bfe652af4af6d6891a8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:17,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:17,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866537559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866537559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866537559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866537559"}]},"ts":"1695866537559"} 2023-09-28 02:02:17,560 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=eb9a86d6902b5573394e4afc96d76d7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,560 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866537560"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866537560"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866537560"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866537560"}]},"ts":"1695866537560"} 2023-09-28 02:02:17,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-28 02:02:17,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure e14ad58a99f57bfe652af4af6d6891a8, server=jenkins-hbase4.apache.org,46883,1695866465849 in 175 msec 2023-09-28 02:02:17,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-28 02:02:17,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure eb9a86d6902b5573394e4afc96d76d7e, server=jenkins-hbase4.apache.org,42313,1695866465812 in 177 msec 2023-09-28 02:02:17,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e14ad58a99f57bfe652af4af6d6891a8, ASSIGN in 336 msec 2023-09-28 02:02:17,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-28 02:02:17,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=eb9a86d6902b5573394e4afc96d76d7e, ASSIGN in 336 msec 2023-09-28 02:02:17,567 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 02:02:17,567 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866537567"}]},"ts":"1695866537567"} 2023-09-28 02:02:17,569 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-28 02:02:17,571 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 02:02:17,571 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-28 02:02:17,573 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 02:02:17,575 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:17,575 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:17,575 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:17,575 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:17,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:17,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:17,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:17,578 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:17,579 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 404 msec 2023-09-28 02:02:17,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-28 02:02:17,782 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-28 02:02:17,784 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,784 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,786 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:02:17,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 02:02:17,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866537798 (current time:1695866537798). 2023-09-28 02:02:17,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:02:17,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x26499ca0 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:17,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42a81efb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:17,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:17,807 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:17,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26499ca0 to 127.0.0.1:56493 2023-09-28 02:02:17,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:17,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x7d0540d2 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:17,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17c36f4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:17,816 DEBUG [hconnection-0x151ee48b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:17,819 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:17,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d0540d2 to 127.0.0.1:56493 2023-09-28 02:02:17,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:17,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 02:02:17,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:02:17,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 02:02:17,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 02:02:17,828 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 02:02:17,828 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695867137828 2023-09-28 02:02:17,828 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 02:02:17,830 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:02:17,830 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:02:17,831 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 02:02:17,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 02:02:17,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-28 02:02:17,833 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 02:02:17,833 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695867137833 2023-09-28 02:02:17,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,843 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-28 02:02:17,843 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:17,844 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-28 02:02:17,844 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-28 02:02:17,844 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,844 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,846 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:17,846 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:17,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:17,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:17,846 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:17,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:17,846 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,847 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,847 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,847 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,847 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 02:02:17,847 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 02:02:17,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,848 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 02:02:17,848 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 02:02:17,848 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:17,848 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:17,849 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 02:02:17,849 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 02:02:17,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,850 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 02:02:17,850 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 02:02:17,850 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 02:02:17,850 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 02:02:17,850 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:17,850 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 02:02:17,851 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 02:02:17,851 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 02:02:17,851 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 02:02:17,852 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,853 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,853 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,853 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,853 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:17,853 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,853 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:17,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:17,853 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,853 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:17,853 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,853 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 02:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d740edb[Count = 1] remaining members to acquire global barrier 2023-09-28 02:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:17,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:17,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 02:02:17,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d740edb[Count = 0] remaining members to acquire global barrier 2023-09-28 02:02:17,857 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-28 02:02:17,858 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,859 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,859 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,860 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 02:02:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 02:02:17,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 02:02:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 02:02:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:17,860 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:02:17,860 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. started... 2023-09-28 02:02:17,860 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,860 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:17,860 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. started... 2023-09-28 02:02:17,862 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eb9a86d6902b5573394e4afc96d76d7e: 2023-09-28 02:02:17,862 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e14ad58a99f57bfe652af4af6d6891a8: 2023-09-28 02:02:17,862 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,862 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,862 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,862 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:17,862 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:17,862 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:02:17,862 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:02:17,868 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 02:02:17,868 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,868 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:17,869 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:02:17,869 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 02:02:17,877 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. completed. 2023-09-28 02:02:17,878 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:02:17,878 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. completed. 2023-09-28 02:02:17,878 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 02:02:17,878 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:02:17,879 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 02:02:17,879 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,879 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:17,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,879 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 02:02:17,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:17,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:17,881 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:17,882 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 02:02:17,882 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:17,882 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 02:02:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:02:17,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-28 02:02:17,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:17,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:17,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:17,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:17,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:17,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:02:17,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-28 02:02:17,889 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-28 02:02:17,889 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:02:17,889 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:02:17,889 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,889 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:02:17,890 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,890 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,890 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,890 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:17,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,891 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,890 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:17,890 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:17,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:17,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:17,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:17,891 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,891 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:17,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:17,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,892 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:17,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,893 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,894 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:17,894 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,898 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:17,898 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:17,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:17,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:17,898 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:17,898 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:17,898 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:17,898 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,900 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:17,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:17,898 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,898 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:17,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:17,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:17,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:17,900 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,900 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:17,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:02:17,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:17,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:17,900 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,901 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,901 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:17,901 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,901 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:17,901 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:17,901 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,901 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 02:02:17,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,930 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:17,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 02:02:17,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:02:17,931 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:02:17,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,933 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-28 02:02:17,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,933 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:17,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695866537829Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695866537908 (+79 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695866537908Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695866537908Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695866537917 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695866537926 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695866537933 (+7 ms) 2023-09-28 02:02:17,936 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 02:02:17,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 107 msec 2023-09-28 02:02:18,132 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:18,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 02:02:18,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:02:18,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46883] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:02:18,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42313] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:02:18,140 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,140 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:18,140 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:02:18,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 02:02:18,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866538150 (current time:1695866538150). 2023-09-28 02:02:18,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:02:18,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x47877aea to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:18,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d0d0daa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:18,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:18,161 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:18,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47877aea to 127.0.0.1:56493 2023-09-28 02:02:18,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:18,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x6c82effc to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:18,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@102e98ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:18,169 DEBUG [hconnection-0x356bb75e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:18,170 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:18,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c82effc to 127.0.0.1:56493 2023-09-28 02:02:18,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:18,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-28 02:02:18,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:02:18,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 02:02:18,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 02:02:18,179 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 02:02:18,179 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695867138179 2023-09-28 02:02:18,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-28 02:02:18,181 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:02:18,182 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:02:18,182 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-28 02:02:18,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 02:02:18,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-28 02:02:18,184 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 02:02:18,184 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695867138184 2023-09-28 02:02:18,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,193 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-28 02:02:18,193 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:18,194 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-28 02:02:18,194 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-28 02:02:18,194 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,195 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,196 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:18,196 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:18,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:18,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:18,196 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,196 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:18,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:18,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:18,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,196 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,196 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:18,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:18,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,197 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,197 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:02:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 02:02:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 02:02:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 02:02:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,198 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 02:02:18,198 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:18,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 02:02:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-28 02:02:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,198 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-28 02:02:18,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,201 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 02:02:18,201 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-28 02:02:18,201 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:18,201 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:18,205 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 02:02:18,205 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 02:02:18,205 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 02:02:18,205 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 02:02:18,205 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-28 02:02:18,205 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-28 02:02:18,205 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 02:02:18,205 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 02:02:18,205 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-28 02:02:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,207 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,207 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:18,207 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:18,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 02:02:18,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f72a681[Count = 1] remaining members to acquire global barrier 2023-09-28 02:02:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:18,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-28 02:02:18,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f72a681[Count = 0] remaining members to acquire global barrier 2023-09-28 02:02:18,211 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-28 02:02:18,212 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 02:02:18,213 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 02:02:18,213 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 02:02:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,213 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:02:18,213 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-28 02:02:18,213 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:18,213 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:18,213 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:18,214 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:18,214 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:18,213 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,214 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:02:18,214 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. started... 2023-09-28 02:02:18,214 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:18,214 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. started... 2023-09-28 02:02:18,214 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e14ad58a99f57bfe652af4af6d6891a8 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-28 02:02:18,214 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eb9a86d6902b5573394e4afc96d76d7e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-28 02:02:18,216 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 02:02:18,216 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:18,216 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 02:02:18,236 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928c595a6b6146a45898569edff28dd62c9 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928c595a6b6146a45898569edff28dd62c9 2023-09-28 02:02:18,236 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309283638416c31f040c0a0e7171e70e7fb93 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309283638416c31f040c0a0e7171e70e7fb93 2023-09-28 02:02:18,253 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/.tmp/cf/0958ec346b484c4d85cd7b0bcc6d9c27 2023-09-28 02:02:18,253 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/.tmp/cf/6db231958b12420f91febd9f3e0d0a5f 2023-09-28 02:02:18,258 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/.tmp/cf/6db231958b12420f91febd9f3e0d0a5f as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/cf/6db231958b12420f91febd9f3e0d0a5f 2023-09-28 02:02:18,258 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/.tmp/cf/0958ec346b484c4d85cd7b0bcc6d9c27 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/cf/0958ec346b484c4d85cd7b0bcc6d9c27 2023-09-28 02:02:18,262 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/cf/6db231958b12420f91febd9f3e0d0a5f, entries=47, sequenceid=6, filesize=13.5 K 2023-09-28 02:02:18,262 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/cf/0958ec346b484c4d85cd7b0bcc6d9c27, entries=3, sequenceid=6, filesize=5.4 K 2023-09-28 02:02:18,263 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for e14ad58a99f57bfe652af4af6d6891a8 in 49ms, sequenceid=6, compaction requested=false 2023-09-28 02:02:18,263 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-28 02:02:18,265 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for eb9a86d6902b5573394e4afc96d76d7e in 51ms, sequenceid=6, compaction requested=false 2023-09-28 02:02:18,265 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-28 02:02:18,266 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e14ad58a99f57bfe652af4af6d6891a8: 2023-09-28 02:02:18,266 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eb9a86d6902b5573394e4afc96d76d7e: 2023-09-28 02:02:18,266 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,266 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,267 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:18,267 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:18,267 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/cf/0958ec346b484c4d85cd7b0bcc6d9c27] hfiles 2023-09-28 02:02:18,267 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/cf/6db231958b12420f91febd9f3e0d0a5f] hfiles 2023-09-28 02:02:18,267 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/cf/6db231958b12420f91febd9f3e0d0a5f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,267 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/cf/0958ec346b484c4d85cd7b0bcc6d9c27 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,278 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. completed. 2023-09-28 02:02:18,278 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:18,278 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:18,278 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:18,278 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,278 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 02:02:18,278 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:02:18,280 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 02:02:18,280 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,280 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:18,280 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 02:02:18,280 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. completed. 2023-09-28 02:02:18,281 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:18,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:18,281 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:18,281 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:18,281 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,281 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-28 02:02:18,281 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:02:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:18,282 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:18,282 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,282 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-28 02:02:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,282 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:18,283 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-28 02:02:18,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 02:02:18,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:02:18,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,284 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:02:18,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:18,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:02:18,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-28 02:02:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:18,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:02:18,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-28 02:02:18,289 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-28 02:02:18,289 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:02:18,289 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:02:18,289 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,289 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:02:18,294 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:18,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:18,294 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:18,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:18,294 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,294 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:18,295 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:18,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:18,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,295 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,297 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:18,297 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,298 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,300 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:18,300 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:18,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:18,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:18,300 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,300 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:18,300 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:18,300 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,300 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:18,300 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,300 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:18,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:18,300 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:18,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:18,301 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:18,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,301 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:18,302 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:18,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:02:18,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:18,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:18,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:18,302 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,302 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,302 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:18,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:18,302 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:18,303 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,303 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,303 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309283638416c31f040c0a0e7171e70e7fb93, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928c595a6b6146a45898569edff28dd62c9] mob files 2023-09-28 02:02:18,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309283638416c31f040c0a0e7171e70e7fb93 2023-09-28 02:02:18,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928c595a6b6146a45898569edff28dd62c9 2023-09-28 02:02:18,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,329 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-28 02:02:18,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,330 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:18,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695866538180Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695866538310 (+130 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695866538310Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695866538310Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695866538313 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695866538322 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695866538329 (+7 ms) 2023-09-28 02:02:18,332 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-28 02:02:18,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 152 msec 2023-09-28 02:02:18,484 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:18,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-28 02:02:18,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:02:18,514 DEBUG [Listener at jenkins-hbase4.apache.org/34629] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 02:02:18,519 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 02:02:18,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 02:02:18,521 DEBUG [Listener at jenkins-hbase4.apache.org/34629] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 02:02:18,525 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 02:02:18,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42313] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 02:02:18,526 DEBUG [Listener at jenkins-hbase4.apache.org/34629] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 02:02:18,531 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 02:02:18,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46883] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-28 02:02:18,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-28 02:02:18,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:18,536 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 02:02:18,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-28 02:02:18,537 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 02:02:18,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 02:02:18,539 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:18,539 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:18,540 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7 empty. 2023-09-28 02:02:18,540 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad empty. 2023-09-28 02:02:18,540 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:18,540 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:18,540 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-28 02:02:18,549 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-28 02:02:18,550 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => fb5c38f6f5df61eb2d3a4c8f98cf12f7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:02:18,551 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9e62c6c7ad7ad7b1538662fdf7f6baad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 9e62c6c7ad7ad7b1538662fdf7f6baad, disabling compactions & flushes 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing fb5c38f6f5df61eb2d3a4c8f98cf12f7, disabling compactions & flushes 2023-09-28 02:02:18,561 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:18,561 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. after waiting 0 ms 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. after waiting 0 ms 2023-09-28 02:02:18,561 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 9e62c6c7ad7ad7b1538662fdf7f6baad: 2023-09-28 02:02:18,561 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:18,561 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for fb5c38f6f5df61eb2d3a4c8f98cf12f7: 2023-09-28 02:02:18,564 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 02:02:18,564 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866538564"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866538564"}]},"ts":"1695866538564"} 2023-09-28 02:02:18,565 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866538564"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866538564"}]},"ts":"1695866538564"} 2023-09-28 02:02:18,567 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 02:02:18,567 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 02:02:18,567 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866538567"}]},"ts":"1695866538567"} 2023-09-28 02:02:18,569 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-28 02:02:18,572 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:02:18,573 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:02:18,573 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:02:18,573 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:02:18,573 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:02:18,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb5c38f6f5df61eb2d3a4c8f98cf12f7, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9e62c6c7ad7ad7b1538662fdf7f6baad, ASSIGN}] 2023-09-28 02:02:18,576 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9e62c6c7ad7ad7b1538662fdf7f6baad, ASSIGN 2023-09-28 02:02:18,576 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb5c38f6f5df61eb2d3a4c8f98cf12f7, ASSIGN 2023-09-28 02:02:18,576 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9e62c6c7ad7ad7b1538662fdf7f6baad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42313,1695866465812; forceNewPlan=false, retain=false 2023-09-28 02:02:18,576 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb5c38f6f5df61eb2d3a4c8f98cf12f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46883,1695866465849; forceNewPlan=false, retain=false 2023-09-28 02:02:18,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 02:02:18,727 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 02:02:18,729 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fb5c38f6f5df61eb2d3a4c8f98cf12f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,729 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9e62c6c7ad7ad7b1538662fdf7f6baad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,730 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866538729"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866538729"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866538729"}]},"ts":"1695866538729"} 2023-09-28 02:02:18,730 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866538729"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866538729"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866538729"}]},"ts":"1695866538729"} 2023-09-28 02:02:18,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure fb5c38f6f5df61eb2d3a4c8f98cf12f7, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:02:18,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 9e62c6c7ad7ad7b1538662fdf7f6baad, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:02:18,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 02:02:18,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:18,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb5c38f6f5df61eb2d3a4c8f98cf12f7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.', STARTKEY => '', ENDKEY => '2'} 2023-09-28 02:02:18,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e62c6c7ad7ad7b1538662fdf7f6baad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.', STARTKEY => '2', ENDKEY => ''} 2023-09-28 02:02:18,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. service=AccessControlService 2023-09-28 02:02:18,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. service=AccessControlService 2023-09-28 02:02:18,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:02:18,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:02:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:18,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:18,889 INFO [StoreOpener-9e62c6c7ad7ad7b1538662fdf7f6baad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:18,889 INFO [StoreOpener-fb5c38f6f5df61eb2d3a4c8f98cf12f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:18,890 DEBUG [StoreOpener-fb5c38f6f5df61eb2d3a4c8f98cf12f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf 2023-09-28 02:02:18,890 DEBUG [StoreOpener-fb5c38f6f5df61eb2d3a4c8f98cf12f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf 2023-09-28 02:02:18,890 DEBUG [StoreOpener-9e62c6c7ad7ad7b1538662fdf7f6baad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/cf 2023-09-28 02:02:18,891 DEBUG [StoreOpener-9e62c6c7ad7ad7b1538662fdf7f6baad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/cf 2023-09-28 02:02:18,891 INFO [StoreOpener-9e62c6c7ad7ad7b1538662fdf7f6baad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e62c6c7ad7ad7b1538662fdf7f6baad columnFamilyName cf 2023-09-28 02:02:18,891 INFO [StoreOpener-fb5c38f6f5df61eb2d3a4c8f98cf12f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb5c38f6f5df61eb2d3a4c8f98cf12f7 columnFamilyName cf 2023-09-28 02:02:18,891 INFO [StoreOpener-9e62c6c7ad7ad7b1538662fdf7f6baad-1] regionserver.HStore(310): Store=9e62c6c7ad7ad7b1538662fdf7f6baad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:02:18,892 INFO [StoreOpener-fb5c38f6f5df61eb2d3a4c8f98cf12f7-1] regionserver.HStore(310): Store=fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:02:18,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:18,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:18,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:18,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:18,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:18,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:18,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:02:18,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:02:18,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fb5c38f6f5df61eb2d3a4c8f98cf12f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69435985, jitterRate=0.03467680513858795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:02:18,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9e62c6c7ad7ad7b1538662fdf7f6baad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59632933, jitterRate=-0.1114000529050827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:02:18,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fb5c38f6f5df61eb2d3a4c8f98cf12f7: 2023-09-28 02:02:18,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9e62c6c7ad7ad7b1538662fdf7f6baad: 2023-09-28 02:02:18,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad., pid=70, masterSystemTime=1695866538883 2023-09-28 02:02:18,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7., pid=69, masterSystemTime=1695866538883 2023-09-28 02:02:18,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:18,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:18,901 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=9e62c6c7ad7ad7b1538662fdf7f6baad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:18,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:18,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:18,901 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866538901"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866538901"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866538901"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866538901"}]},"ts":"1695866538901"} 2023-09-28 02:02:18,901 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fb5c38f6f5df61eb2d3a4c8f98cf12f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:18,902 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866538901"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866538901"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866538901"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866538901"}]},"ts":"1695866538901"} 2023-09-28 02:02:18,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-28 02:02:18,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 9e62c6c7ad7ad7b1538662fdf7f6baad, server=jenkins-hbase4.apache.org,42313,1695866465812 in 171 msec 2023-09-28 02:02:18,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-28 02:02:18,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure fb5c38f6f5df61eb2d3a4c8f98cf12f7, server=jenkins-hbase4.apache.org,46883,1695866465849 in 172 msec 2023-09-28 02:02:18,905 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9e62c6c7ad7ad7b1538662fdf7f6baad, ASSIGN in 331 msec 2023-09-28 02:02:18,907 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-28 02:02:18,907 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb5c38f6f5df61eb2d3a4c8f98cf12f7, ASSIGN in 332 msec 2023-09-28 02:02:18,907 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 02:02:18,907 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866538907"}]},"ts":"1695866538907"} 2023-09-28 02:02:18,909 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-28 02:02:18,912 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 02:02:18,912 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-28 02:02:18,914 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-28 02:02:18,915 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:18,915 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:18,915 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:18,915 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:18,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:18,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:18,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:18,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:18,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:18,917 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:18,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:18,918 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:18,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 383 msec 2023-09-28 02:02:19,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-28 02:02:19,141 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-28 02:02:19,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions fb5c38f6f5df61eb2d3a4c8f98cf12f7, 9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:19,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fb5c38f6f5df61eb2d3a4c8f98cf12f7, 9e62c6c7ad7ad7b1538662fdf7f6baad], force=true 2023-09-28 02:02:19,172 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fb5c38f6f5df61eb2d3a4c8f98cf12f7, 9e62c6c7ad7ad7b1538662fdf7f6baad], force=true 2023-09-28 02:02:19,172 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fb5c38f6f5df61eb2d3a4c8f98cf12f7, 9e62c6c7ad7ad7b1538662fdf7f6baad], force=true 2023-09-28 02:02:19,172 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fb5c38f6f5df61eb2d3a4c8f98cf12f7, 9e62c6c7ad7ad7b1538662fdf7f6baad], force=true 2023-09-28 02:02:19,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 02:02:19,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb5c38f6f5df61eb2d3a4c8f98cf12f7, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9e62c6c7ad7ad7b1538662fdf7f6baad, UNASSIGN}] 2023-09-28 02:02:19,195 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9e62c6c7ad7ad7b1538662fdf7f6baad, UNASSIGN 2023-09-28 02:02:19,195 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb5c38f6f5df61eb2d3a4c8f98cf12f7, UNASSIGN 2023-09-28 02:02:19,196 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9e62c6c7ad7ad7b1538662fdf7f6baad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:19,196 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=fb5c38f6f5df61eb2d3a4c8f98cf12f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:19,196 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866539196"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866539196"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866539196"}]},"ts":"1695866539196"} 2023-09-28 02:02:19,196 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866539196"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866539196"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866539196"}]},"ts":"1695866539196"} 2023-09-28 02:02:19,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 9e62c6c7ad7ad7b1538662fdf7f6baad, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:02:19,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure fb5c38f6f5df61eb2d3a4c8f98cf12f7, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:02:19,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 02:02:19,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:19,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:19,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9e62c6c7ad7ad7b1538662fdf7f6baad, disabling compactions & flushes 2023-09-28 02:02:19,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fb5c38f6f5df61eb2d3a4c8f98cf12f7, disabling compactions & flushes 2023-09-28 02:02:19,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:19,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:19,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:19,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:19,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. after waiting 0 ms 2023-09-28 02:02:19,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. after waiting 0 ms 2023-09-28 02:02:19,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:19,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:19,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9e62c6c7ad7ad7b1538662fdf7f6baad 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-28 02:02:19,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fb5c38f6f5df61eb2d3a4c8f98cf12f7 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-28 02:02:19,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/.tmp/cf/403b533fc2a0457ea34bed97dfadc344 2023-09-28 02:02:19,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/.tmp/cf/d84907ba5e424feb9c649b21341b124e 2023-09-28 02:02:19,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/.tmp/cf/d84907ba5e424feb9c649b21341b124e as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf/d84907ba5e424feb9c649b21341b124e 2023-09-28 02:02:19,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/.tmp/cf/403b533fc2a0457ea34bed97dfadc344 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/cf/403b533fc2a0457ea34bed97dfadc344 2023-09-28 02:02:19,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf/d84907ba5e424feb9c649b21341b124e, entries=1, sequenceid=5, filesize=4.7 K 2023-09-28 02:02:19,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/cf/403b533fc2a0457ea34bed97dfadc344, entries=1, sequenceid=5, filesize=4.7 K 2023-09-28 02:02:19,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for fb5c38f6f5df61eb2d3a4c8f98cf12f7 in 29ms, sequenceid=5, compaction requested=false 2023-09-28 02:02:19,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 9e62c6c7ad7ad7b1538662fdf7f6baad in 29ms, sequenceid=5, compaction requested=false 2023-09-28 02:02:19,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-28 02:02:19,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-28 02:02:19,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-28 02:02:19,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-28 02:02:19,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:19,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:19,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad. 2023-09-28 02:02:19,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7. 2023-09-28 02:02:19,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9e62c6c7ad7ad7b1538662fdf7f6baad: 2023-09-28 02:02:19,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fb5c38f6f5df61eb2d3a4c8f98cf12f7: 2023-09-28 02:02:19,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:19,392 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=9e62c6c7ad7ad7b1538662fdf7f6baad, regionState=CLOSED 2023-09-28 02:02:19,392 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866539392"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866539392"}]},"ts":"1695866539392"} 2023-09-28 02:02:19,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:19,393 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=fb5c38f6f5df61eb2d3a4c8f98cf12f7, regionState=CLOSED 2023-09-28 02:02:19,393 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695866539393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866539393"}]},"ts":"1695866539393"} 2023-09-28 02:02:19,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-28 02:02:19,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 9e62c6c7ad7ad7b1538662fdf7f6baad, server=jenkins-hbase4.apache.org,42313,1695866465812 in 197 msec 2023-09-28 02:02:19,397 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-28 02:02:19,397 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure fb5c38f6f5df61eb2d3a4c8f98cf12f7, server=jenkins-hbase4.apache.org,46883,1695866465849 in 196 msec 2023-09-28 02:02:19,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9e62c6c7ad7ad7b1538662fdf7f6baad, UNASSIGN in 203 msec 2023-09-28 02:02:19,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-28 02:02:19,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fb5c38f6f5df61eb2d3a4c8f98cf12f7, UNASSIGN in 207 msec 2023-09-28 02:02:19,441 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-28 02:02:19,444 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538534.fb5c38f6f5df61eb2d3a4c8f98cf12f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:19,444 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695866538534.9e62c6c7ad7ad7b1538662fdf7f6baad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:19,444 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:19,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 02:02:19,494 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9906b1069d23f9706b085604192dee0b, ASSIGN}] 2023-09-28 02:02:19,495 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9906b1069d23f9706b085604192dee0b, ASSIGN 2023-09-28 02:02:19,496 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9906b1069d23f9706b085604192dee0b, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,46883,1695866465849; forceNewPlan=false, retain=false 2023-09-28 02:02:19,646 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-28 02:02:19,648 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9906b1069d23f9706b085604192dee0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:19,648 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695866539648"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866539648"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866539648"}]},"ts":"1695866539648"} 2023-09-28 02:02:19,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 9906b1069d23f9706b085604192dee0b, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:02:19,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 02:02:19,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. 2023-09-28 02:02:19,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9906b1069d23f9706b085604192dee0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.', STARTKEY => '', ENDKEY => ''} 2023-09-28 02:02:19,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. service=AccessControlService 2023-09-28 02:02:19,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:02:19,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:19,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:19,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:19,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:19,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/.regioninfo 2023-09-28 02:02:19,816 INFO [StoreOpener-9906b1069d23f9706b085604192dee0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:19,817 DEBUG [StoreOpener-9906b1069d23f9706b085604192dee0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf 2023-09-28 02:02:19,817 DEBUG [StoreOpener-9906b1069d23f9706b085604192dee0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf 2023-09-28 02:02:19,818 INFO [StoreOpener-9906b1069d23f9706b085604192dee0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9906b1069d23f9706b085604192dee0b columnFamilyName cf 2023-09-28 02:02:19,845 DEBUG [StoreOpener-9906b1069d23f9706b085604192dee0b-1] regionserver.HStore(539): loaded hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/403b533fc2a0457ea34bed97dfadc344.9e62c6c7ad7ad7b1538662fdf7f6baad->hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/cf/403b533fc2a0457ea34bed97dfadc344-top 2023-09-28 02:02:19,849 DEBUG [StoreOpener-9906b1069d23f9706b085604192dee0b-1] regionserver.HStore(539): loaded hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/d84907ba5e424feb9c649b21341b124e.fb5c38f6f5df61eb2d3a4c8f98cf12f7->hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf/d84907ba5e424feb9c649b21341b124e-top 2023-09-28 02:02:19,850 INFO [StoreOpener-9906b1069d23f9706b085604192dee0b-1] regionserver.HStore(310): Store=9906b1069d23f9706b085604192dee0b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:02:19,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:19,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:19,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:19,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9906b1069d23f9706b085604192dee0b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75123519, jitterRate=0.11942766606807709}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:02:19,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9906b1069d23f9706b085604192dee0b: 2023-09-28 02:02:19,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b., pid=77, masterSystemTime=1695866539801 2023-09-28 02:02:19,856 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.,because compaction is disabled. 2023-09-28 02:02:19,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. 2023-09-28 02:02:19,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. 2023-09-28 02:02:19,858 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9906b1069d23f9706b085604192dee0b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:19,858 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695866539858"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866539858"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866539858"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866539858"}]},"ts":"1695866539858"} 2023-09-28 02:02:19,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-28 02:02:19,861 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 9906b1069d23f9706b085604192dee0b, server=jenkins-hbase4.apache.org,46883,1695866465849 in 211 msec 2023-09-28 02:02:19,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-28 02:02:19,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9906b1069d23f9706b085604192dee0b, ASSIGN in 367 msec 2023-09-28 02:02:19,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[fb5c38f6f5df61eb2d3a4c8f98cf12f7, 9e62c6c7ad7ad7b1538662fdf7f6baad], force=true in 698 msec 2023-09-28 02:02:20,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-28 02:02:20,278 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-28 02:02:20,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 02:02:20,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866540279 (current time:1695866540279). 2023-09-28 02:02:20,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:02:20,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x495d79f2 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:20,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@641ae9cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:20,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:20,289 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:20,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x495d79f2 to 127.0.0.1:56493 2023-09-28 02:02:20,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:20,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x523e8438 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:20,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@708ee564, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:20,297 DEBUG [hconnection-0x43e92630-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:20,299 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:20,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x523e8438 to 127.0.0.1:56493 2023-09-28 02:02:20,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:20,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-28 02:02:20,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:02:20,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 02:02:20,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 02:02:20,307 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 02:02:20,308 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695867140308 2023-09-28 02:02:20,308 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-28 02:02:20,311 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:02:20,311 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:02:20,312 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-28 02:02:20,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 02:02:20,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-09-28 02:02:20,314 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 02:02:20,315 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695867140315 2023-09-28 02:02:20,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,327 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-28 02:02:20,327 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:20,328 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-28 02:02:20,328 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-28 02:02:20,328 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,329 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,330 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:20,330 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:20,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:20,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:20,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:20,330 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,330 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:20,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:20,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:20,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:20,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,330 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,331 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 02:02:20,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,332 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-28 02:02:20,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,333 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 02:02:20,334 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:20,334 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 02:02:20,334 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:20,337 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,338 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 02:02:20,338 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-28 02:02:20,338 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:20,338 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 02:02:20,339 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-28 02:02:20,340 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 02:02:20,338 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 02:02:20,340 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 02:02:20,340 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-28 02:02:20,340 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 02:02:20,340 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-28 02:02:20,341 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,341 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,341 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:20,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:20,341 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,342 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,342 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:20,342 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,342 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:20,342 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,342 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:20,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-28 02:02:20,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6722f0a3[Count = 0] remaining members to acquire global barrier 2023-09-28 02:02:20,344 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-28 02:02:20,344 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 02:02:20,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 02:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-28 02:02:20,345 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,346 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 02:02:20,345 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 02:02:20,346 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:20,346 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. 2023-09-28 02:02:20,346 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:20,346 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:02:20,346 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:02:20,346 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. started... 2023-09-28 02:02:20,347 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9906b1069d23f9706b085604192dee0b: 2023-09-28 02:02:20,348 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,348 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:20,348 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/403b533fc2a0457ea34bed97dfadc344.9e62c6c7ad7ad7b1538662fdf7f6baad->hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/cf/403b533fc2a0457ea34bed97dfadc344-top, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/d84907ba5e424feb9c649b21341b124e.fb5c38f6f5df61eb2d3a4c8f98cf12f7->hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf/d84907ba5e424feb9c649b21341b124e-top] hfiles 2023-09-28 02:02:20,348 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/403b533fc2a0457ea34bed97dfadc344.9e62c6c7ad7ad7b1538662fdf7f6baad for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,348 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/d84907ba5e424feb9c649b21341b124e.fb5c38f6f5df61eb2d3a4c8f98cf12f7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 02:02:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:20,349 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 02:02:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 02:02:20,350 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:20,351 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 02:02:20,361 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. completed. 2023-09-28 02:02:20,361 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. 2023-09-28 02:02:20,361 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:20,361 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:20,361 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,361 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-28 02:02:20,361 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:02:20,371 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-28 02:02:20,371 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,371 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,371 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-28 02:02:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:20,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:20,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:02:20,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-28 02:02:20,374 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-28 02:02:20,374 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:02:20,374 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:02:20,374 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,374 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:02:20,377 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:20,377 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:20,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:20,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:20,377 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:20,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,377 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:20,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:20,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:20,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:20,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:20,378 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:20,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:20,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,379 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:20,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:20,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:20,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,380 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:20,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:20,381 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:20,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:20,381 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,383 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:20,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:20,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:20,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:20,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:20,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:20,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:20,384 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:20,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:20,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:20,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:20,384 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:20,385 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:20,385 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,385 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:20,385 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:20,385 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,385 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:20,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:20,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,408 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,409 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-28 02:02:20,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,409 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695866540308Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695866540385 (+77 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695866540385Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695866540388 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695866540401 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695866540409 (+8 ms) 2023-09-28 02:02:20,412 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-28 02:02:20,412 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:20,413 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 101 msec 2023-09-28 02:02:20,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-28 02:02:20,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:02:20,414 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414 2023-09-28 02:02:20,414 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35003, tgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414, rawTgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414, srcFsUri=hdfs://localhost:35003, srcDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:02:20,436 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:02:20,436 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1205183274_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,436 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d, snapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-28 02:02:20,445 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:20,464 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:20,465 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:20,465 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:20,466 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:21,376 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-1054242311857242268.jar 2023-09-28 02:02:21,377 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:21,377 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:21,444 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-5680035995839019138.jar 2023-09-28 02:02:21,445 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:21,445 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:21,446 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:21,446 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:21,446 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:21,447 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:21,447 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 02:02:21,447 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 02:02:21,448 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 02:02:21,448 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 02:02:21,448 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 02:02:21,449 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 02:02:21,449 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 02:02:21,449 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 02:02:21,450 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 02:02:21,450 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 02:02:21,451 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:21,451 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:21,452 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:21,452 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:21,452 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:21,453 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:21,453 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:21,579 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0004_000001 (auth:SIMPLE) 2023-09-28 02:02:21,818 WARN [Listener at jenkins-hbase4.apache.org/34629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 02:02:21,820 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-28 02:02:21,822 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-28 02:02:21,885 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:02:21,885 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:02:22,448 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 02:02:22,555 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0005_000001 (auth:SIMPLE) 2023-09-28 02:02:26,369 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0005_000001 (auth:SIMPLE) 2023-09-28 02:02:28,591 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0005_000001 (auth:SIMPLE) 2023-09-28 02:02:31,011 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0005_000001 (auth:SIMPLE) 2023-09-28 02:02:32,986 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 02:02:32,989 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 02:02:32,997 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:32,998 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 02:02:32,998 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 02:02:32,998 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:32,999 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-28 02:02:32,999 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-28 02:02:32,999 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:32,999 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-28 02:02:32,999 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866540414/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-28 02:02:33,005 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 02:02:33,009 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866553009"}]},"ts":"1695866553009"} 2023-09-28 02:02:33,011 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-28 02:02:33,012 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-28 02:02:33,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9906b1069d23f9706b085604192dee0b, UNASSIGN}] 2023-09-28 02:02:33,015 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9906b1069d23f9706b085604192dee0b, UNASSIGN 2023-09-28 02:02:33,015 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9906b1069d23f9706b085604192dee0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:33,016 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695866553015"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866553015"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866553015"}]},"ts":"1695866553015"} 2023-09-28 02:02:33,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 9906b1069d23f9706b085604192dee0b, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:02:33,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 02:02:33,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:33,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9906b1069d23f9706b085604192dee0b, disabling compactions & flushes 2023-09-28 02:02:33,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. 2023-09-28 02:02:33,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. 2023-09-28 02:02:33,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. after waiting 0 ms 2023-09-28 02:02:33,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. 2023-09-28 02:02:33,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-28 02:02:33,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:33,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b. 2023-09-28 02:02:33,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9906b1069d23f9706b085604192dee0b: 2023-09-28 02:02:33,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:33,183 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9906b1069d23f9706b085604192dee0b, regionState=CLOSED 2023-09-28 02:02:33,183 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695866553183"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866553183"}]},"ts":"1695866553183"} 2023-09-28 02:02:33,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-28 02:02:33,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 9906b1069d23f9706b085604192dee0b, server=jenkins-hbase4.apache.org,46883,1695866465849 in 167 msec 2023-09-28 02:02:33,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-28 02:02:33,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=9906b1069d23f9706b085604192dee0b, UNASSIGN in 173 msec 2023-09-28 02:02:33,188 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866553188"}]},"ts":"1695866553188"} 2023-09-28 02:02:33,189 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-28 02:02:33,191 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-28 02:02:33,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-09-28 02:02:33,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-28 02:02:33,312 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-28 02:02:33,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,316 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,316 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,318 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,320 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:33,321 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:33,321 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:33,322 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,322 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,322 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,322 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 02:02:33,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 02:02:33,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 02:02:33,323 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-28 02:02:33,323 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/recovered.edits] 2023-09-28 02:02:33,323 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/recovered.edits] 2023-09-28 02:02:33,323 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,323 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,323 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,323 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,323 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:33,323 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:33,323 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:33,323 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:33,324 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/recovered.edits] 2023-09-28 02:02:33,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:33,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:33,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-28 02:02:33,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:33,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:33,331 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/403b533fc2a0457ea34bed97dfadc344.9e62c6c7ad7ad7b1538662fdf7f6baad to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/403b533fc2a0457ea34bed97dfadc344.9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:33,332 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/cf/403b533fc2a0457ea34bed97dfadc344 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/cf/403b533fc2a0457ea34bed97dfadc344 2023-09-28 02:02:33,332 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf/d84907ba5e424feb9c649b21341b124e to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/cf/d84907ba5e424feb9c649b21341b124e 2023-09-28 02:02:33,333 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/d84907ba5e424feb9c649b21341b124e.fb5c38f6f5df61eb2d3a4c8f98cf12f7 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/cf/d84907ba5e424feb9c649b21341b124e.fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:33,335 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/recovered.edits/8.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad/recovered.edits/8.seqid 2023-09-28 02:02:33,335 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9e62c6c7ad7ad7b1538662fdf7f6baad 2023-09-28 02:02:33,336 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/recovered.edits/8.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7/recovered.edits/8.seqid 2023-09-28 02:02:33,336 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fb5c38f6f5df61eb2d3a4c8f98cf12f7 2023-09-28 02:02:33,337 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/recovered.edits/12.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b/recovered.edits/12.seqid 2023-09-28 02:02:33,337 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/9906b1069d23f9706b085604192dee0b 2023-09-28 02:02:33,337 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-28 02:02:33,339 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,342 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-28 02:02:33,343 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-28 02:02:33,344 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,344 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-28 02:02:33,344 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866553344"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:33,346 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-28 02:02:33,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9906b1069d23f9706b085604192dee0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695866538535.9906b1069d23f9706b085604192dee0b.', STARTKEY => '', ENDKEY => ''}] 2023-09-28 02:02:33,346 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-28 02:02:33,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695866553346"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:33,347 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-28 02:02:33,349 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 36 msec 2023-09-28 02:02:33,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-28 02:02:33,426 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-28 02:02:33,427 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 02:02:33,431 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866553431"}]},"ts":"1695866553431"} 2023-09-28 02:02:33,433 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-28 02:02:33,434 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-28 02:02:33,435 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e14ad58a99f57bfe652af4af6d6891a8, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=eb9a86d6902b5573394e4afc96d76d7e, UNASSIGN}] 2023-09-28 02:02:33,437 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e14ad58a99f57bfe652af4af6d6891a8, UNASSIGN 2023-09-28 02:02:33,437 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=eb9a86d6902b5573394e4afc96d76d7e, UNASSIGN 2023-09-28 02:02:33,437 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=eb9a86d6902b5573394e4afc96d76d7e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:33,437 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e14ad58a99f57bfe652af4af6d6891a8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:33,438 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866553437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866553437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866553437"}]},"ts":"1695866553437"} 2023-09-28 02:02:33,438 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866553437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866553437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866553437"}]},"ts":"1695866553437"} 2023-09-28 02:02:33,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure eb9a86d6902b5573394e4afc96d76d7e, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:02:33,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure e14ad58a99f57bfe652af4af6d6891a8, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:02:33,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 02:02:33,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:33,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:33,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eb9a86d6902b5573394e4afc96d76d7e, disabling compactions & flushes 2023-09-28 02:02:33,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e14ad58a99f57bfe652af4af6d6891a8, disabling compactions & flushes 2023-09-28 02:02:33,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:33,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:33,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:33,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:33,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. after waiting 0 ms 2023-09-28 02:02:33,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:33,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. after waiting 0 ms 2023-09-28 02:02:33,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:33,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:02:33,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:02:33,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:33,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:33,601 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8. 2023-09-28 02:02:33,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e14ad58a99f57bfe652af4af6d6891a8: 2023-09-28 02:02:33,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e. 2023-09-28 02:02:33,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eb9a86d6902b5573394e4afc96d76d7e: 2023-09-28 02:02:33,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:33,604 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e14ad58a99f57bfe652af4af6d6891a8, regionState=CLOSED 2023-09-28 02:02:33,604 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866553604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866553604"}]},"ts":"1695866553604"} 2023-09-28 02:02:33,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:33,605 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=eb9a86d6902b5573394e4afc96d76d7e, regionState=CLOSED 2023-09-28 02:02:33,605 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695866553604"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866553604"}]},"ts":"1695866553604"} 2023-09-28 02:02:33,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-28 02:02:33,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure e14ad58a99f57bfe652af4af6d6891a8, server=jenkins-hbase4.apache.org,46883,1695866465849 in 166 msec 2023-09-28 02:02:33,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-28 02:02:33,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure eb9a86d6902b5573394e4afc96d76d7e, server=jenkins-hbase4.apache.org,42313,1695866465812 in 168 msec 2023-09-28 02:02:33,609 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e14ad58a99f57bfe652af4af6d6891a8, UNASSIGN in 173 msec 2023-09-28 02:02:33,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-28 02:02:33,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=eb9a86d6902b5573394e4afc96d76d7e, UNASSIGN in 174 msec 2023-09-28 02:02:33,611 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866553611"}]},"ts":"1695866553611"} 2023-09-28 02:02:33,612 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-28 02:02:33,614 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-28 02:02:33,616 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 188 msec 2023-09-28 02:02:33,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-28 02:02:33,734 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-28 02:02:33,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,738 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,738 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,739 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,742 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,742 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,742 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,742 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 02:02:33,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 02:02:33,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 02:02:33,742 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-28 02:02:33,743 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:33,743 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:33,743 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,743 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,743 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:33,743 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,743 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,743 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:33,743 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:33,743 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:33,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-28 02:02:33,745 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/recovered.edits] 2023-09-28 02:02:33,745 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/recovered.edits] 2023-09-28 02:02:33,749 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/cf/0958ec346b484c4d85cd7b0bcc6d9c27 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/cf/0958ec346b484c4d85cd7b0bcc6d9c27 2023-09-28 02:02:33,749 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/cf/6db231958b12420f91febd9f3e0d0a5f to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/cf/6db231958b12420f91febd9f3e0d0a5f 2023-09-28 02:02:33,751 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8/recovered.edits/9.seqid 2023-09-28 02:02:33,751 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e/recovered.edits/9.seqid 2023-09-28 02:02:33,752 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e14ad58a99f57bfe652af4af6d6891a8 2023-09-28 02:02:33,752 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/eb9a86d6902b5573394e4afc96d76d7e 2023-09-28 02:02:33,752 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-28 02:02:33,753 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-28 02:02:33,753 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-28 02:02:33,757 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309283638416c31f040c0a0e7171e70e7fb93 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309283638416c31f040c0a0e7171e70e7fb93 2023-09-28 02:02:33,758 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928c595a6b6146a45898569edff28dd62c9 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230928c595a6b6146a45898569edff28dd62c9 2023-09-28 02:02:33,758 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-28 02:02:33,760 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,762 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-28 02:02:33,764 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-28 02:02:33,765 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,765 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-28 02:02:33,765 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866553765"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:33,766 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866553765"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:33,767 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 02:02:33,767 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e14ad58a99f57bfe652af4af6d6891a8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695866537173.e14ad58a99f57bfe652af4af6d6891a8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => eb9a86d6902b5573394e4afc96d76d7e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695866537173.eb9a86d6902b5573394e4afc96d76d7e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 02:02:33,767 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-28 02:02:33,767 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695866553767"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:33,769 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-28 02:02:33,771 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 36 msec 2023-09-28 02:02:33,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-28 02:02:33,846 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-28 02:02:33,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-28 02:02:33,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-28 02:02:33,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-28 02:02:33,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-28 02:02:33,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-28 02:02:33,887 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=754 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-614961860_1 at /127.0.0.1:56852 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4073 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:39647 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:44540 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1464117681_17 at /127.0.0.1:50962 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:56878 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=140 (was 128) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4171 (was 4243) 2023-09-28 02:02:33,887 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-28 02:02:33,906 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=754, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=140, ProcessCount=168, AvailableMemoryMB=4171 2023-09-28 02:02:33,906 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-09-28 02:02:33,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 02:02:33,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 02:02:33,911 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 02:02:33,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-28 02:02:33,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 02:02:33,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 02:02:33,914 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de 2023-09-28 02:02:33,914 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:33,915 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de empty. 2023-09-28 02:02:33,915 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1 empty. 2023-09-28 02:02:33,915 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de 2023-09-28 02:02:33,915 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:33,915 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-28 02:02:33,924 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-28 02:02:33,925 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 599231c7baba31815fac450e546480de, NAME => 'testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:02:33,926 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => cc29d7705479360c198c3a205672afa1, NAME => 'testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 599231c7baba31815fac450e546480de, disabling compactions & flushes 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing cc29d7705479360c198c3a205672afa1, disabling compactions & flushes 2023-09-28 02:02:33,936 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:33,936 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. after waiting 0 ms 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. after waiting 0 ms 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:33,936 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:33,936 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 599231c7baba31815fac450e546480de: 2023-09-28 02:02:33,936 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for cc29d7705479360c198c3a205672afa1: 2023-09-28 02:02:33,938 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 02:02:33,939 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866553939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866553939"}]},"ts":"1695866553939"} 2023-09-28 02:02:33,939 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866553939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866553939"}]},"ts":"1695866553939"} 2023-09-28 02:02:33,941 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 02:02:33,942 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 02:02:33,942 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866553942"}]},"ts":"1695866553942"} 2023-09-28 02:02:33,943 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-28 02:02:33,946 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:02:33,947 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:02:33,947 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:02:33,947 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:02:33,947 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:02:33,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=599231c7baba31815fac450e546480de, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc29d7705479360c198c3a205672afa1, ASSIGN}] 2023-09-28 02:02:33,950 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc29d7705479360c198c3a205672afa1, ASSIGN 2023-09-28 02:02:33,950 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=599231c7baba31815fac450e546480de, ASSIGN 2023-09-28 02:02:33,951 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc29d7705479360c198c3a205672afa1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46883,1695866465849; forceNewPlan=false, retain=false 2023-09-28 02:02:33,951 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=599231c7baba31815fac450e546480de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42313,1695866465812; forceNewPlan=false, retain=false 2023-09-28 02:02:34,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 02:02:34,101 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 02:02:34,104 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cc29d7705479360c198c3a205672afa1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,104 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=599231c7baba31815fac450e546480de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,104 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866554103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866554103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866554103"}]},"ts":"1695866554103"} 2023-09-28 02:02:34,104 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866554103"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866554103"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866554103"}]},"ts":"1695866554103"} 2023-09-28 02:02:34,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure cc29d7705479360c198c3a205672afa1, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:02:34,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 599231c7baba31815fac450e546480de, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:02:34,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 02:02:34,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:34,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:34,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 599231c7baba31815fac450e546480de, NAME => 'testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 02:02:34,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cc29d7705479360c198c3a205672afa1, NAME => 'testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 02:02:34,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. service=AccessControlService 2023-09-28 02:02:34,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. service=AccessControlService 2023-09-28 02:02:34,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:02:34,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:02:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 599231c7baba31815fac450e546480de 2023-09-28 02:02:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 599231c7baba31815fac450e546480de 2023-09-28 02:02:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:34,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 599231c7baba31815fac450e546480de 2023-09-28 02:02:34,262 INFO [StoreOpener-cc29d7705479360c198c3a205672afa1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:34,262 INFO [StoreOpener-599231c7baba31815fac450e546480de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 599231c7baba31815fac450e546480de 2023-09-28 02:02:34,263 DEBUG [StoreOpener-cc29d7705479360c198c3a205672afa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/cf 2023-09-28 02:02:34,263 DEBUG [StoreOpener-cc29d7705479360c198c3a205672afa1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/cf 2023-09-28 02:02:34,263 DEBUG [StoreOpener-599231c7baba31815fac450e546480de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/cf 2023-09-28 02:02:34,263 DEBUG [StoreOpener-599231c7baba31815fac450e546480de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/cf 2023-09-28 02:02:34,264 INFO [StoreOpener-cc29d7705479360c198c3a205672afa1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cc29d7705479360c198c3a205672afa1 columnFamilyName cf 2023-09-28 02:02:34,264 INFO [StoreOpener-599231c7baba31815fac450e546480de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 599231c7baba31815fac450e546480de columnFamilyName cf 2023-09-28 02:02:34,265 INFO [StoreOpener-cc29d7705479360c198c3a205672afa1-1] regionserver.HStore(310): Store=cc29d7705479360c198c3a205672afa1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:02:34,265 INFO [StoreOpener-599231c7baba31815fac450e546480de-1] regionserver.HStore(310): Store=599231c7baba31815fac450e546480de/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:02:34,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:34,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de 2023-09-28 02:02:34,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:34,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de 2023-09-28 02:02:34,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:34,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 599231c7baba31815fac450e546480de 2023-09-28 02:02:34,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:02:34,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:02:34,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cc29d7705479360c198c3a205672afa1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72342226, jitterRate=0.07798317074775696}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:02:34,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cc29d7705479360c198c3a205672afa1: 2023-09-28 02:02:34,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 599231c7baba31815fac450e546480de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67226039, jitterRate=0.0017460435628890991}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:02:34,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 599231c7baba31815fac450e546480de: 2023-09-28 02:02:34,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1., pid=93, masterSystemTime=1695866554257 2023-09-28 02:02:34,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de., pid=94, masterSystemTime=1695866554257 2023-09-28 02:02:34,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:34,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:34,273 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=cc29d7705479360c198c3a205672afa1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:34,273 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866554273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866554273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866554273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866554273"}]},"ts":"1695866554273"} 2023-09-28 02:02:34,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:34,274 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=599231c7baba31815fac450e546480de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,274 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866554274"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866554274"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866554274"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866554274"}]},"ts":"1695866554274"} 2023-09-28 02:02:34,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-28 02:02:34,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure cc29d7705479360c198c3a205672afa1, server=jenkins-hbase4.apache.org,46883,1695866465849 in 170 msec 2023-09-28 02:02:34,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-28 02:02:34,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 599231c7baba31815fac450e546480de, server=jenkins-hbase4.apache.org,42313,1695866465812 in 169 msec 2023-09-28 02:02:34,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc29d7705479360c198c3a205672afa1, ASSIGN in 329 msec 2023-09-28 02:02:34,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-28 02:02:34,278 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=599231c7baba31815fac450e546480de, ASSIGN in 330 msec 2023-09-28 02:02:34,279 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 02:02:34,279 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866554279"}]},"ts":"1695866554279"} 2023-09-28 02:02:34,280 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-28 02:02:34,282 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 02:02:34,282 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-28 02:02:34,284 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 02:02:34,286 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:34,286 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:34,286 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:34,286 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:34,287 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:34,287 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:34,287 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:34,287 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:34,289 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 379 msec 2023-09-28 02:02:34,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-28 02:02:34,516 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-28 02:02:34,518 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-28 02:02:34,519 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:34,520 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:02:34,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:02:34,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866554531 (current time:1695866554531). 2023-09-28 02:02:34,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:02:34,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x580a2a65 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:34,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d4b572c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:34,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:34,543 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:34,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x580a2a65 to 127.0.0.1:56493 2023-09-28 02:02:34,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:34,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x5e12df76 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:34,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57429fd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:34,551 DEBUG [hconnection-0x60074020-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:34,552 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:34,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e12df76 to 127.0.0.1:56493 2023-09-28 02:02:34,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:34,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 02:02:34,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:02:34,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:02:34,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:02:34,560 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:02:34,560 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695867154560 2023-09-28 02:02:34,560 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-28 02:02:34,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:02:34,561 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:02:34,562 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:02:34,562 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 02:02:34,562 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:02:34,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-28 02:02:34,566 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 02:02:34,567 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695867154567 2023-09-28 02:02:34,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,580 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-28 02:02:34,580 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:34,581 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-28 02:02:34,581 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-28 02:02:34,582 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,582 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,588 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:34,588 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:34,588 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:34,588 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:34,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:34,588 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,588 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:34,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,589 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,589 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 02:02:34,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-28 02:02:34,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,590 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 02:02:34,590 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 02:02:34,590 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 02:02:34,590 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:34,591 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 02:02:34,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,591 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 02:02:34,591 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 02:02:34,591 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:34,591 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 02:02:34,592 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 02:02:34,592 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 02:02:34,592 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 02:02:34,591 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:34,592 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 02:02:34,593 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 02:02:34,593 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 02:02:34,593 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 02:02:34,594 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,595 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,595 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:34,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:34,595 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,595 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:34,595 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,595 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:34,596 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,596 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:34,596 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,596 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:34,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:34,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:34,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 02:02:34,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a183f20[Count = 1] remaining members to acquire global barrier 2023-09-28 02:02:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:34,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 02:02:34,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a183f20[Count = 0] remaining members to acquire global barrier 2023-09-28 02:02:34,599 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 02:02:34,600 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,602 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:02:34,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,602 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:02:34,602 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:02:34,602 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 02:02:34,602 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:02:34,602 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,602 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:02:34,603 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 02:02:34,603 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:34,603 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 02:02:34,610 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:34,610 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:34,610 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:34,610 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:34,610 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:34,610 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:34,610 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. started... 2023-09-28 02:02:34,610 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. started... 2023-09-28 02:02:34,611 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc29d7705479360c198c3a205672afa1: 2023-09-28 02:02:34,611 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 599231c7baba31815fac450e546480de: 2023-09-28 02:02:34,611 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,612 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:34,612 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:02:34,612 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,612 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:34,612 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:02:34,630 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. completed. 2023-09-28 02:02:34,630 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:34,630 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. completed. 2023-09-28 02:02:34,630 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 02:02:34,630 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:02:34,632 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 02:02:34,632 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 02:02:34,632 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,632 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:34,632 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,632 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:34,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,632 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 02:02:34,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:34,633 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 02:02:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:34,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:02:34,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 02:02:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:34,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:02:34,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 02:02:34,640 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-28 02:02:34,640 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:02:34,640 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:02:34,640 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,640 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:02:34,641 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,641 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:34,641 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:34,641 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,642 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:34,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,641 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,642 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,642 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:34,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:34,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:34,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:34,642 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:34,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,643 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:34,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,644 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:34,645 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,645 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,648 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:34,648 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,648 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:34,648 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:34,648 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,648 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:34,648 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-28 02:02:34,648 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:34,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:34,648 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:34,648 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:34,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:34,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,648 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:34,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:02:34,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:34,648 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:34,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:34,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:34,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:34,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:34,649 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:34,650 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,650 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,650 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,650 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:34,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:34,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 02:02:34,650 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,650 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,651 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,662 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:34,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 02:02:34,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:02:34,663 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:02:34,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,672 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-28 02:02:34,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695866554560Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695866554657 (+97 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695866554657Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695866554657Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695866554660 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695866554667 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695866554672 (+5 ms) 2023-09-28 02:02:34,675 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 02:02:34,676 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 114 msec 2023-09-28 02:02:34,863 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:34,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 02:02:34,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:02:34,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42313] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:02:34,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46883] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:02:34,870 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-28 02:02:34,870 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:34,870 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:02:34,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:02:34,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866554880 (current time:1695866554880). 2023-09-28 02:02:34,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:02:34,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x28f15080 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:34,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72ad03fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:34,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:34,891 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54352, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:34,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28f15080 to 127.0.0.1:56493 2023-09-28 02:02:34,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:34,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x365bd8ea to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:34,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@140cebf1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:34,900 DEBUG [hconnection-0xe24b87d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:34,903 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:34,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x365bd8ea to 127.0.0.1:56493 2023-09-28 02:02:34,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:34,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-28 02:02:34,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:02:34,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:02:34,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:02:34,913 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:02:34,914 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695867154914 2023-09-28 02:02:34,914 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-28 02:02:34,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-28 02:02:34,915 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:02:34,915 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:02:34,919 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-28 02:02:34,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 02:02:34,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-28 02:02:34,921 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 02:02:34,921 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695867154921 2023-09-28 02:02:34,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,930 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-28 02:02:34,930 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:34,932 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-28 02:02:34,932 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-28 02:02:34,932 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,932 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,934 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:34,934 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:34,934 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:34,934 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:34,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:34,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:34,934 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,934 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,935 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,935 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-28 02:02:34,935 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,936 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 02:02:34,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,936 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:34,936 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 02:02:34,936 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,937 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:34,937 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 02:02:34,939 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 02:02:34,939 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 02:02:34,939 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 02:02:34,939 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 02:02:34,937 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-28 02:02:34,939 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 02:02:34,939 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:34,942 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-28 02:02:34,942 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-28 02:02:34,942 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-28 02:02:34,943 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,944 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,944 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,944 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,944 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:34,944 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,944 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,944 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,945 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:34,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:34,944 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,945 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:34,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:34,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:34,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:34,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 02:02:34,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4777ee6e[Count = 1] remaining members to acquire global barrier 2023-09-28 02:02:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:34,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:34,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-28 02:02:34,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4777ee6e[Count = 0] remaining members to acquire global barrier 2023-09-28 02:02:34,949 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-28 02:02:34,949 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:34,954 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:02:34,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:34,954 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:02:34,954 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 02:02:34,954 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:02:34,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:34,954 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:34,955 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-28 02:02:34,955 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. started... 2023-09-28 02:02:34,954 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:34,954 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:34,955 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:02:34,955 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:34,955 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:34,955 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cc29d7705479360c198c3a205672afa1 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-28 02:02:34,955 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:34,955 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. started... 2023-09-28 02:02:34,955 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 599231c7baba31815fac450e546480de 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-28 02:02:34,956 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 02:02:34,956 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:34,956 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 02:02:34,978 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230928bc91530f0d044d95837dd84bbedba2a8 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928bc91530f0d044d95837dd84bbedba2a8 2023-09-28 02:02:34,980 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309288e6194d3483d4709a87a7074f9f3a546 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309288e6194d3483d4709a87a7074f9f3a546 2023-09-28 02:02:34,986 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/.tmp/cf/413a7592d12a42929ae7eecbccc9ffb9 2023-09-28 02:02:34,988 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/.tmp/cf/da2de37635d8419084fb2cabdcfe6423 2023-09-28 02:02:34,992 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/.tmp/cf/413a7592d12a42929ae7eecbccc9ffb9 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/cf/413a7592d12a42929ae7eecbccc9ffb9 2023-09-28 02:02:34,993 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/.tmp/cf/da2de37635d8419084fb2cabdcfe6423 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/cf/da2de37635d8419084fb2cabdcfe6423 2023-09-28 02:02:34,999 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/cf/413a7592d12a42929ae7eecbccc9ffb9, entries=3, sequenceid=6, filesize=5.4 K 2023-09-28 02:02:34,999 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/cf/da2de37635d8419084fb2cabdcfe6423, entries=47, sequenceid=6, filesize=13.1 K 2023-09-28 02:02:35,000 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 599231c7baba31815fac450e546480de in 45ms, sequenceid=6, compaction requested=false 2023-09-28 02:02:35,000 INFO [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for cc29d7705479360c198c3a205672afa1 in 45ms, sequenceid=6, compaction requested=false 2023-09-28 02:02:35,000 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-28 02:02:35,000 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-28 02:02:35,004 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 599231c7baba31815fac450e546480de: 2023-09-28 02:02:35,004 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cc29d7705479360c198c3a205672afa1: 2023-09-28 02:02:35,004 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,004 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,005 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:35,005 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:35,005 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/cf/413a7592d12a42929ae7eecbccc9ffb9] hfiles 2023-09-28 02:02:35,005 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/cf/da2de37635d8419084fb2cabdcfe6423] hfiles 2023-09-28 02:02:35,005 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/cf/413a7592d12a42929ae7eecbccc9ffb9 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,005 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/cf/da2de37635d8419084fb2cabdcfe6423 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,017 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. completed. 2023-09-28 02:02:35,017 DEBUG [rs(jenkins-hbase4.apache.org,46883,1695866465849)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:35,017 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:35,017 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:35,017 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,019 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:35,020 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 02:02:35,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 02:02:35,020 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:02:35,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:02:35,021 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:02:35,022 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 02:02:35,022 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:35,022 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 02:02:35,024 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:35,024 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. completed. 2023-09-28 02:02:35,025 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:35,025 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:35,025 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:35,025 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,025 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-28 02:02:35,025 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:02:35,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:35,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,032 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-28 02:02:35,032 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,032 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,032 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-28 02:02:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:35,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46883,1695866465849': 2023-09-28 02:02:35,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-28 02:02:35,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:35,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:35,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:02:35,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-28 02:02:35,038 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-28 02:02:35,038 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:02:35,038 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:02:35,039 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,039 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:02:35,040 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,040 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,040 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,040 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:35,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,040 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:35,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,040 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:35,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,040 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,041 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:35,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:35,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:35,041 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,041 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,043 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,043 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,044 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:35,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:35,046 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:35,046 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:35,048 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-28 02:02:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:35,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:02:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:35,048 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:35,048 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:35,046 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:35,048 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:35,048 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:35,048 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,048 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:35,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309288e6194d3483d4709a87a7074f9f3a546, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928bc91530f0d044d95837dd84bbedba2a8] mob files 2023-09-28 02:02:35,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309288e6194d3483d4709a87a7074f9f3a546 2023-09-28 02:02:35,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928bc91530f0d044d95837dd84bbedba2a8 2023-09-28 02:02:35,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,075 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-28 02:02:35,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,075 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695866554914Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695866555056 (+142 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695866555056Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695866555056Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695866555059 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695866555069 (+10 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695866555075 (+6 ms) 2023-09-28 02:02:35,078 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-28 02:02:35,079 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 163 msec 2023-09-28 02:02:35,221 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:35,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-28 02:02:35,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:02:35,222 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222 2023-09-28 02:02:35,223 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35003, tgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222, rawTgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222, srcFsUri=hdfs://localhost:35003, srcDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:02:35,244 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:02:35,244 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1827038633_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,244 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d, snapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-28 02:02:35,250 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:35,265 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:35,266 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:35,266 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:35,266 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:36,136 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-928627962041396891.jar 2023-09-28 02:02:36,137 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:36,137 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:36,204 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-5247287118892720150.jar 2023-09-28 02:02:36,204 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:36,204 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:36,205 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:36,205 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:36,205 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:36,206 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:36,206 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 02:02:36,206 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 02:02:36,207 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 02:02:36,207 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 02:02:36,207 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 02:02:36,208 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 02:02:36,208 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 02:02:36,208 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 02:02:36,209 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 02:02:36,209 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 02:02:36,210 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:36,210 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:36,211 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:36,211 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:36,211 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:36,212 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:36,212 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:36,572 WARN [Listener at jenkins-hbase4.apache.org/34629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 02:02:36,574 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-28 02:02:37,185 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:02:37,185 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:02:37,188 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0005_000001 (auth:SIMPLE) 2023-09-28 02:02:37,584 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0006_000001 (auth:SIMPLE) 2023-09-28 02:02:38,787 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 02:02:41,445 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0006_000001 (auth:SIMPLE) 2023-09-28 02:02:43,907 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 02:02:43,908 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 02:02:43,914 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:43,914 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 02:02:43,915 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 02:02:43,915 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:43,916 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-28 02:02:43,916 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-28 02:02:43,916 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:43,916 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-28 02:02:43,916 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866555222/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-28 02:02:43,921 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-28 02:02:43,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-28 02:02:43,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 02:02:43,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 02:02:43,925 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866563925"}]},"ts":"1695866563925"} 2023-09-28 02:02:43,927 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-28 02:02:43,928 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-28 02:02:43,929 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=599231c7baba31815fac450e546480de, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc29d7705479360c198c3a205672afa1, UNASSIGN}] 2023-09-28 02:02:43,931 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=599231c7baba31815fac450e546480de, UNASSIGN 2023-09-28 02:02:43,931 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc29d7705479360c198c3a205672afa1, UNASSIGN 2023-09-28 02:02:43,932 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=599231c7baba31815fac450e546480de, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:43,932 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cc29d7705479360c198c3a205672afa1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:43,932 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866563932"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866563932"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866563932"}]},"ts":"1695866563932"} 2023-09-28 02:02:43,932 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866563932"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866563932"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866563932"}]},"ts":"1695866563932"} 2023-09-28 02:02:43,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 599231c7baba31815fac450e546480de, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:02:43,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure cc29d7705479360c198c3a205672afa1, server=jenkins-hbase4.apache.org,46883,1695866465849}] 2023-09-28 02:02:44,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 02:02:44,085 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:44,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 599231c7baba31815fac450e546480de 2023-09-28 02:02:44,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cc29d7705479360c198c3a205672afa1, disabling compactions & flushes 2023-09-28 02:02:44,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:44,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:44,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 599231c7baba31815fac450e546480de, disabling compactions & flushes 2023-09-28 02:02:44,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. after waiting 0 ms 2023-09-28 02:02:44,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:44,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:44,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:44,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. after waiting 0 ms 2023-09-28 02:02:44,086 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:44,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:02:44,094 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:02:44,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:44,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1. 2023-09-28 02:02:44,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:44,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cc29d7705479360c198c3a205672afa1: 2023-09-28 02:02:44,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de. 2023-09-28 02:02:44,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 599231c7baba31815fac450e546480de: 2023-09-28 02:02:44,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:44,099 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=cc29d7705479360c198c3a205672afa1, regionState=CLOSED 2023-09-28 02:02:44,099 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866564099"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866564099"}]},"ts":"1695866564099"} 2023-09-28 02:02:44,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 599231c7baba31815fac450e546480de 2023-09-28 02:02:44,099 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=599231c7baba31815fac450e546480de, regionState=CLOSED 2023-09-28 02:02:44,100 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695866564099"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866564099"}]},"ts":"1695866564099"} 2023-09-28 02:02:44,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-28 02:02:44,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure cc29d7705479360c198c3a205672afa1, server=jenkins-hbase4.apache.org,46883,1695866465849 in 166 msec 2023-09-28 02:02:44,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-28 02:02:44,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 599231c7baba31815fac450e546480de, server=jenkins-hbase4.apache.org,42313,1695866465812 in 168 msec 2023-09-28 02:02:44,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cc29d7705479360c198c3a205672afa1, UNASSIGN in 173 msec 2023-09-28 02:02:44,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-28 02:02:44,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=599231c7baba31815fac450e546480de, UNASSIGN in 174 msec 2023-09-28 02:02:44,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866564105"}]},"ts":"1695866564105"} 2023-09-28 02:02:44,106 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-28 02:02:44,109 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-28 02:02:44,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 188 msec 2023-09-28 02:02:44,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-28 02:02:44,228 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-28 02:02:44,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,231 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,232 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,234 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,236 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,236 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de 2023-09-28 02:02:44,236 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,236 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:44,236 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,236 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 02:02:44,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 02:02:44,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 02:02:44,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-28 02:02:44,238 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,238 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:44,238 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,238 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,238 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,238 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/recovered.edits] 2023-09-28 02:02:44,238 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:44,238 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:44,238 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:44,238 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/recovered.edits] 2023-09-28 02:02:44,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-28 02:02:44,243 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/cf/413a7592d12a42929ae7eecbccc9ffb9 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/cf/413a7592d12a42929ae7eecbccc9ffb9 2023-09-28 02:02:44,243 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/cf/da2de37635d8419084fb2cabdcfe6423 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/cf/da2de37635d8419084fb2cabdcfe6423 2023-09-28 02:02:44,245 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de/recovered.edits/9.seqid 2023-09-28 02:02:44,245 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1/recovered.edits/9.seqid 2023-09-28 02:02:44,246 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/599231c7baba31815fac450e546480de 2023-09-28 02:02:44,246 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testEmptyExportFileSystemState/cc29d7705479360c198c3a205672afa1 2023-09-28 02:02:44,246 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-28 02:02:44,247 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-28 02:02:44,247 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-28 02:02:44,250 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309288e6194d3483d4709a87a7074f9f3a546 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309288e6194d3483d4709a87a7074f9f3a546 2023-09-28 02:02:44,251 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928bc91530f0d044d95837dd84bbedba2a8 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230928bc91530f0d044d95837dd84bbedba2a8 2023-09-28 02:02:44,252 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-28 02:02:44,254 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,256 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-28 02:02:44,258 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-28 02:02:44,259 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,259 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-28 02:02:44,259 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866564259"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:44,260 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866564259"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:44,261 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 02:02:44,261 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 599231c7baba31815fac450e546480de, NAME => 'testtb-testEmptyExportFileSystemState,,1695866553908.599231c7baba31815fac450e546480de.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => cc29d7705479360c198c3a205672afa1, NAME => 'testtb-testEmptyExportFileSystemState,1,1695866553908.cc29d7705479360c198c3a205672afa1.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 02:02:44,261 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-28 02:02:44,262 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695866564261"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:44,263 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-28 02:02:44,266 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-28 02:02:44,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 38 msec 2023-09-28 02:02:44,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-28 02:02:44,341 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-28 02:02:44,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-28 02:02:44,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:44,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-28 02:02:44,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-28 02:02:44,380 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 754) Potentially hanging thread: hconnection-0x52070e30-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:60872 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:34859 from appattempt_1695866472266_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:37704 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:44705 from appattempt_1695866472266_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:50674 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:40097 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1019041382_1 at /127.0.0.1:50652 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1019041382_1 at /127.0.0.1:37680 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4721 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=927 (was 910) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=118 (was 140), ProcessCount=168 (was 168), AvailableMemoryMB=4053 (was 4171) 2023-09-28 02:02:44,380 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-28 02:02:44,402 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=118, ProcessCount=168, AvailableMemoryMB=4052 2023-09-28 02:02:44,402 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-28 02:02:44,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-28 02:02:44,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:44,407 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-28 02:02:44,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-28 02:02:44,408 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-28 02:02:44,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 02:02:44,410 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:44,410 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:44,411 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9 empty. 2023-09-28 02:02:44,411 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74 empty. 2023-09-28 02:02:44,411 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:44,411 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:44,411 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-28 02:02:44,421 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-28 02:02:44,422 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 307e79415d70153caa0ca66502bcab74, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:02:44,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2e7911f4ba45c60b3bf4876cd8b3c7a9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp 2023-09-28 02:02:44,436 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:44,436 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 307e79415d70153caa0ca66502bcab74, disabling compactions & flushes 2023-09-28 02:02:44,436 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:44,436 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:44,436 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. after waiting 0 ms 2023-09-28 02:02:44,436 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:44,436 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:44,436 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 307e79415d70153caa0ca66502bcab74: 2023-09-28 02:02:44,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:44,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 2e7911f4ba45c60b3bf4876cd8b3c7a9, disabling compactions & flushes 2023-09-28 02:02:44,438 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:44,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:44,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. after waiting 0 ms 2023-09-28 02:02:44,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:44,438 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:44,438 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 2e7911f4ba45c60b3bf4876cd8b3c7a9: 2023-09-28 02:02:44,440 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-28 02:02:44,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866564441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866564441"}]},"ts":"1695866564441"} 2023-09-28 02:02:44,441 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866564441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866564441"}]},"ts":"1695866564441"} 2023-09-28 02:02:44,443 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-28 02:02:44,443 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-28 02:02:44,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866564444"}]},"ts":"1695866564444"} 2023-09-28 02:02:44,445 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-28 02:02:44,448 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-28 02:02:44,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-28 02:02:44,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-28 02:02:44,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-28 02:02:44,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-28 02:02:44,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=307e79415d70153caa0ca66502bcab74, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2e7911f4ba45c60b3bf4876cd8b3c7a9, ASSIGN}] 2023-09-28 02:02:44,452 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=307e79415d70153caa0ca66502bcab74, ASSIGN 2023-09-28 02:02:44,452 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2e7911f4ba45c60b3bf4876cd8b3c7a9, ASSIGN 2023-09-28 02:02:44,453 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=307e79415d70153caa0ca66502bcab74, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41721,1695866465754; forceNewPlan=false, retain=false 2023-09-28 02:02:44,453 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2e7911f4ba45c60b3bf4876cd8b3c7a9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42313,1695866465812; forceNewPlan=false, retain=false 2023-09-28 02:02:44,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 02:02:44,603 INFO [jenkins-hbase4:44049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-28 02:02:44,606 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=307e79415d70153caa0ca66502bcab74, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:44,606 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2e7911f4ba45c60b3bf4876cd8b3c7a9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:44,606 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866564606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866564606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866564606"}]},"ts":"1695866564606"} 2023-09-28 02:02:44,606 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866564606"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866564606"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866564606"}]},"ts":"1695866564606"} 2023-09-28 02:02:44,608 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 307e79415d70153caa0ca66502bcab74, server=jenkins-hbase4.apache.org,41721,1695866465754}] 2023-09-28 02:02:44,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 2e7911f4ba45c60b3bf4876cd8b3c7a9, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:02:44,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 02:02:44,761 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:44,761 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-28 02:02:44,766 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-28 02:02:44,767 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:44,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2e7911f4ba45c60b3bf4876cd8b3c7a9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.', STARTKEY => '1', ENDKEY => ''} 2023-09-28 02:02:44,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. service=AccessControlService 2023-09-28 02:02:44,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:02:44,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:44,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:44,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:44,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:44,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:44,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 307e79415d70153caa0ca66502bcab74, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.', STARTKEY => '', ENDKEY => '1'} 2023-09-28 02:02:44,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. service=AccessControlService 2023-09-28 02:02:44,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-28 02:02:44,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:44,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-28 02:02:44,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:44,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:44,770 INFO [StoreOpener-2e7911f4ba45c60b3bf4876cd8b3c7a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:44,771 INFO [StoreOpener-307e79415d70153caa0ca66502bcab74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:44,771 DEBUG [StoreOpener-2e7911f4ba45c60b3bf4876cd8b3c7a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/cf 2023-09-28 02:02:44,772 DEBUG [StoreOpener-2e7911f4ba45c60b3bf4876cd8b3c7a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/cf 2023-09-28 02:02:44,772 INFO [StoreOpener-2e7911f4ba45c60b3bf4876cd8b3c7a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2e7911f4ba45c60b3bf4876cd8b3c7a9 columnFamilyName cf 2023-09-28 02:02:44,772 DEBUG [StoreOpener-307e79415d70153caa0ca66502bcab74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/cf 2023-09-28 02:02:44,772 DEBUG [StoreOpener-307e79415d70153caa0ca66502bcab74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/cf 2023-09-28 02:02:44,773 INFO [StoreOpener-307e79415d70153caa0ca66502bcab74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 307e79415d70153caa0ca66502bcab74 columnFamilyName cf 2023-09-28 02:02:44,773 INFO [StoreOpener-2e7911f4ba45c60b3bf4876cd8b3c7a9-1] regionserver.HStore(310): Store=2e7911f4ba45c60b3bf4876cd8b3c7a9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:02:44,774 INFO [StoreOpener-307e79415d70153caa0ca66502bcab74-1] regionserver.HStore(310): Store=307e79415d70153caa0ca66502bcab74/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-28 02:02:44,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:44,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:44,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:44,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:44,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:44,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:44,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:02:44,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2e7911f4ba45c60b3bf4876cd8b3c7a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60576319, jitterRate=-0.09734250605106354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:02:44,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2e7911f4ba45c60b3bf4876cd8b3c7a9: 2023-09-28 02:02:44,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-28 02:02:44,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9., pid=109, masterSystemTime=1695866564761 2023-09-28 02:02:44,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 307e79415d70153caa0ca66502bcab74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64777913, jitterRate=-0.03473387658596039}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-28 02:02:44,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 307e79415d70153caa0ca66502bcab74: 2023-09-28 02:02:44,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74., pid=108, masterSystemTime=1695866564761 2023-09-28 02:02:44,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:44,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:44,786 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2e7911f4ba45c60b3bf4876cd8b3c7a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:44,786 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866564786"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866564786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866564786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866564786"}]},"ts":"1695866564786"} 2023-09-28 02:02:44,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:44,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:44,787 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=307e79415d70153caa0ca66502bcab74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:44,788 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866564787"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695866564787"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695866564787"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695866564787"}]},"ts":"1695866564787"} 2023-09-28 02:02:44,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-28 02:02:44,791 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 2e7911f4ba45c60b3bf4876cd8b3c7a9, server=jenkins-hbase4.apache.org,42313,1695866465812 in 181 msec 2023-09-28 02:02:44,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-28 02:02:44,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 307e79415d70153caa0ca66502bcab74, server=jenkins-hbase4.apache.org,41721,1695866465754 in 182 msec 2023-09-28 02:02:44,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2e7911f4ba45c60b3bf4876cd8b3c7a9, ASSIGN in 342 msec 2023-09-28 02:02:44,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-28 02:02:44,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=307e79415d70153caa0ca66502bcab74, ASSIGN in 342 msec 2023-09-28 02:02:44,793 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-28 02:02:44,794 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866564794"}]},"ts":"1695866564794"} 2023-09-28 02:02:44,795 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-28 02:02:44,797 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-28 02:02:44,797 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-28 02:02:44,799 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 02:02:44,800 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:44,800 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:44,800 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:44,800 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:44,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:44,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:44,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:44,802 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-28 02:02:44,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 398 msec 2023-09-28 02:02:45,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-28 02:02:45,012 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-28 02:02:45,014 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,014 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:45,017 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:02:45,023 DEBUG [hconnection-0x1efc3b9f-shared-pool-34] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:45,025 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:45,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 02:02:45,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866565029 (current time:1695866565029). 2023-09-28 02:02:45,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:02:45,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x4b5a4556 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:45,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3925314a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:45,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:45,042 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:45,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b5a4556 to 127.0.0.1:56493 2023-09-28 02:02:45,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:45,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x6f12bbd5 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:45,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76fb3394, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:45,050 DEBUG [hconnection-0x6644e360-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:45,051 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:45,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f12bbd5 to 127.0.0.1:56493 2023-09-28 02:02:45,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:45,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 02:02:45,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:02:45,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 02:02:45,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 02:02:45,059 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 02:02:45,059 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695867165059 2023-09-28 02:02:45,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 02:02:45,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,060 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:02:45,061 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:02:45,061 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 02:02:45,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 02:02:45,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-28 02:02:45,063 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 02:02:45,064 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695867165064 2023-09-28 02:02:45,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,073 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-28 02:02:45,073 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:45,074 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-28 02:02:45,074 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-28 02:02:45,074 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,075 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,077 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,077 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,077 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,077 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,078 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,078 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,078 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,078 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:02:45,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 02:02:45,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 02:02:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:45,079 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 02:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 02:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 02:02:45,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 02:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 02:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:45,080 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:45,081 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 02:02:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 02:02:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 02:02:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 02:02:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 02:02:45,082 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 02:02:45,088 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,089 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,089 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,089 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,090 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,090 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 02:02:45,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d0b0eaf[Count = 1] remaining members to acquire global barrier 2023-09-28 02:02:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 02:02:45,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d0b0eaf[Count = 0] remaining members to acquire global barrier 2023-09-28 02:02:45,093 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-28 02:02:45,093 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,094 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,094 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,094 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 02:02:45,095 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 02:02:45,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:02:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 02:02:45,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 02:02:45,095 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,095 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:02:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:45,095 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:45,095 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:45,095 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. started... 2023-09-28 02:02:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:45,095 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. started... 2023-09-28 02:02:45,095 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:45,096 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 307e79415d70153caa0ca66502bcab74: 2023-09-28 02:02:45,097 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2e7911f4ba45c60b3bf4876cd8b3c7a9: 2023-09-28 02:02:45,097 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,097 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 02:02:45,097 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:02:45,097 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:45,097 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:45,097 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 02:02:45,098 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-28 02:02:45,112 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. completed. 2023-09-28 02:02:45,112 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:45,112 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:45,112 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:45,112 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,112 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 02:02:45,112 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:02:45,115 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 02:02:45,115 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,115 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:45,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,116 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 02:02:45,117 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. completed. 2023-09-28 02:02:45,117 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:45,117 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 02:02:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:02:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,119 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 02:02:45,119 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,119 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:45,119 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 02:02:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41721,1695866465754': 2023-09-28 02:02:45,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-28 02:02:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:02:45,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-28 02:02:45,127 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-28 02:02:45,128 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:02:45,128 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:02:45,128 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,128 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:02:45,129 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,129 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,129 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,129 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,130 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,130 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,130 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,130 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,131 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,131 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,133 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,133 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,134 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,136 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,137 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,137 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,136 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,137 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:45,137 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,137 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,137 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,137 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,137 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,139 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,139 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:02:45,139 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,140 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,140 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,140 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,140 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,140 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-28 02:02:45,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,161 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:45,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 02:02:45,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:02:45,162 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:02:45,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,173 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-28 02:02:45,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,174 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695866565060Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695866565150 (+90 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695866565150Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695866565150Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695866565155 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695866565167 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695866565173 (+6 ms) 2023-09-28 02:02:45,177 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 02:02:45,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 117 msec 2023-09-28 02:02:45,362 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:45,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 02:02:45,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:02:45,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41721] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:02:45,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42313] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. with WAL disabled. Data may be lost in the event of a crash. 2023-09-28 02:02:45,369 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,369 DEBUG [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:45,369 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-28 02:02:45,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 02:02:45,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695866565378 (current time:1695866565378). 2023-09-28 02:02:45,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-28 02:02:45,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x1d0ad0dc to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:45,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c947ffe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:45,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:45,389 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:45,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d0ad0dc to 127.0.0.1:56493 2023-09-28 02:02:45,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:45,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(139): Connect 0x10587457 to 127.0.0.1:56493 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-28 02:02:45,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b1fcab0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-28 02:02:45,397 DEBUG [hconnection-0x248b35a2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-28 02:02:45,399 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-28 02:02:45,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10587457 to 127.0.0.1:56493 2023-09-28 02:02:45,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:02:45,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-28 02:02:45,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-28 02:02:45,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 02:02:45,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 02:02:45,408 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 02:02:45,408 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695867165408 2023-09-28 02:02:45,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-28 02:02:45,409 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-28 02:02:45,410 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-28 02:02:45,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 02:02:45,411 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-28 02:02:45,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-28 02:02:45,412 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 02:02:45,413 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695867165413 2023-09-28 02:02:45,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,425 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-28 02:02:45,425 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:45,426 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-28 02:02:45,426 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-28 02:02:45,427 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,427 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,429 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,429 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,429 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,429 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,429 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,429 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,430 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,430 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 02:02:45,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-28 02:02:45,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,431 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 02:02:45,431 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 02:02:45,431 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:45,431 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:45,432 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 02:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 02:02:45,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 02:02:45,433 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 02:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-28 02:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 02:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46883,1695866465849' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 02:02:45,434 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-28 02:02:45,435 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-28 02:02:45,435 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-28 02:02:45,435 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-28 02:02:45,436 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,436 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,436 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,437 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,437 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-28 02:02:45,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42313,1695866465812' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 02:02:45,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ddc4e45[Count = 1] remaining members to acquire global barrier 2023-09-28 02:02:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41721,1695866465754' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-28 02:02:45,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ddc4e45[Count = 0] remaining members to acquire global barrier 2023-09-28 02:02:45,441 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-28 02:02:45,441 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 02:02:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 02:02:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-28 02:02:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 02:02:45,447 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,447 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-28 02:02:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46883,1695866465849' in zk 2023-09-28 02:02:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:45,447 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-28 02:02:45,448 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-28 02:02:45,448 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:45,448 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:45,448 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. started... 2023-09-28 02:02:45,448 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. started... 2023-09-28 02:02:45,448 INFO [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 307e79415d70153caa0ca66502bcab74 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-28 02:02:45,448 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2e7911f4ba45c60b3bf4876cd8b3c7a9 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-28 02:02:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 02:02:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:45,449 DEBUG [member: 'jenkins-hbase4.apache.org,46883,1695866465849' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 02:02:45,466 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092887b6845ca6de481a877eeb3b608e0577 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092887b6845ca6de481a877eeb3b608e0577 2023-09-28 02:02:45,466 INFO [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309285d57906c6be344e8ab78f07ef93ad06f to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309285d57906c6be344e8ab78f07ef93ad06f 2023-09-28 02:02:45,476 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/.tmp/cf/c0f2732ae8384918b40a994d1dc240ed 2023-09-28 02:02:45,476 INFO [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/.tmp/cf/d342ba1d7e0c4ec7a2683d275e3b3814 2023-09-28 02:02:45,480 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/.tmp/cf/d342ba1d7e0c4ec7a2683d275e3b3814 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/cf/d342ba1d7e0c4ec7a2683d275e3b3814 2023-09-28 02:02:45,480 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/.tmp/cf/c0f2732ae8384918b40a994d1dc240ed as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/cf/c0f2732ae8384918b40a994d1dc240ed 2023-09-28 02:02:45,484 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/cf/c0f2732ae8384918b40a994d1dc240ed, entries=48, sequenceid=6, filesize=13.5 K 2023-09-28 02:02:45,484 INFO [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/cf/d342ba1d7e0c4ec7a2683d275e3b3814, entries=2, sequenceid=6, filesize=5.2 K 2023-09-28 02:02:45,485 INFO [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 307e79415d70153caa0ca66502bcab74 in 37ms, sequenceid=6, compaction requested=false 2023-09-28 02:02:45,485 INFO [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 2e7911f4ba45c60b3bf4876cd8b3c7a9 in 37ms, sequenceid=6, compaction requested=false 2023-09-28 02:02:45,485 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-28 02:02:45,485 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-28 02:02:45,488 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 307e79415d70153caa0ca66502bcab74: 2023-09-28 02:02:45,488 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2e7911f4ba45c60b3bf4876cd8b3c7a9: 2023-09-28 02:02:45,489 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,489 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,489 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:45,489 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-28 02:02:45,489 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/cf/d342ba1d7e0c4ec7a2683d275e3b3814] hfiles 2023-09-28 02:02:45,489 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/cf/c0f2732ae8384918b40a994d1dc240ed] hfiles 2023-09-28 02:02:45,489 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/cf/c0f2732ae8384918b40a994d1dc240ed for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,489 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/cf/d342ba1d7e0c4ec7a2683d275e3b3814 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,501 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. completed. 2023-09-28 02:02:45,501 DEBUG [rs(jenkins-hbase4.apache.org,42313,1695866465812)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 02:02:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42313,1695866465812' in zk 2023-09-28 02:02:45,503 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 02:02:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,504 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. completed. 2023-09-28 02:02:45,503 DEBUG [member: 'jenkins-hbase4.apache.org,42313,1695866465812' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 02:02:45,505 DEBUG [rs(jenkins-hbase4.apache.org,41721,1695866465754)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-28 02:02:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-28 02:02:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-28 02:02:45,505 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41721,1695866465754' in zk 2023-09-28 02:02:45,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-28 02:02:45,506 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:45,506 DEBUG [member: 'jenkins-hbase4.apache.org,41721,1695866465754' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-28 02:02:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,510 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42313,1695866465812': 2023-09-28 02:02:45,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42313,1695866465812' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-28 02:02:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 02:02:45,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-28 02:02:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,511 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-28 02:02:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41721,1695866465754': 2023-09-28 02:02:45,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41721,1695866465754' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-28 02:02:45,513 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-28 02:02:45,513 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-28 02:02:45,513 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-28 02:02:45,513 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,514 INFO [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-28 02:02:45,516 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,516 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,516 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-28 02:02:45,516 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,517 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,516 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,517 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,517 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,518 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-28 02:02:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,518 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-28 02:02:45,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,520 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,520 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,520 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-28 02:02:45,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-28 02:02:45,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,523 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:02:45,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-28 02:02:45,524 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-28 02:02:45,524 DEBUG [(jenkins-hbase4.apache.org,44049,1695866464521)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-28 02:02:45,524 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:45,524 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,524 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:45,524 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,524 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,524 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,524 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-28 02:02:45,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092887b6845ca6de481a877eeb3b608e0577, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309285d57906c6be344e8ab78f07ef93ad06f] mob files 2023-09-28 02:02:45,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092887b6845ca6de481a877eeb3b608e0577 2023-09-28 02:02:45,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309285d57906c6be344e8ab78f07ef93ad06f 2023-09-28 02:02:45,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-28 02:02:45,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,550 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695866565408Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695866565533 (+125 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695866565533Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695866565533Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695866565536 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695866565543 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695866565550 (+7 ms) 2023-09-28 02:02:45,553 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-28 02:02:45,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 144 msec 2023-09-28 02:02:45,711 DEBUG [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-28 02:02:45,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-28 02:02:45,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-28 02:02:45,712 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712 2023-09-28 02:02:45,713 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35003, tgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712, rawTgtDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712, srcFsUri=hdfs://localhost:35003, srcDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:02:45,735 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d 2023-09-28 02:02:45,735 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_368720451_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,735 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35003, inputRoot=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d, snapshotDir=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-28 02:02:45,747 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:45,764 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:45,765 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:45,765 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:45,765 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:46,642 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-1038425196503224569.jar 2023-09-28 02:02:46,643 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:46,643 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:46,710 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/hadoop-8918398558629728042.jar 2023-09-28 02:02:46,710 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:46,711 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:46,711 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:46,712 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:46,712 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:46,712 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-28 02:02:46,713 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-28 02:02:46,713 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-28 02:02:46,713 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-28 02:02:46,714 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-28 02:02:46,714 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-28 02:02:46,714 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-28 02:02:46,715 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-28 02:02:46,715 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-28 02:02:46,715 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-28 02:02:46,716 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-28 02:02:46,716 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:46,717 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:46,717 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:46,717 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:46,718 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-28 02:02:46,718 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:46,719 DEBUG [Listener at jenkins-hbase4.apache.org/34629] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-28 02:02:47,058 WARN [Listener at jenkins-hbase4.apache.org/34629] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-28 02:02:47,060 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-28 02:02:47,062 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-28 02:02:48,777 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:02:48,777 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-28 02:02:48,783 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0006_000001 (auth:SIMPLE) 2023-09-28 02:02:49,195 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0007_000001 (auth:SIMPLE) 2023-09-28 02:02:49,671 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 02:02:52,878 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0007_000001 (auth:SIMPLE) 2023-09-28 02:02:55,088 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0007_000001 (auth:SIMPLE) 2023-09-28 02:02:57,655 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695866472266_0007_000001 (auth:SIMPLE) 2023-09-28 02:02:59,237 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-28 02:02:59,238 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-28 02:02:59,250 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,250 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-28 02:02:59,251 INFO [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-28 02:02:59,251 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,251 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-28 02:02:59,252 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-28 02:02:59,252 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1324532370_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,252 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-28 02:02:59,252 DEBUG [Listener at jenkins-hbase4.apache.org/34629] snapshot.TestExportSnapshot(367): hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/export-test/export-1695866565712/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-28 02:02:59,259 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 02:02:59,263 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866579263"}]},"ts":"1695866579263"} 2023-09-28 02:02:59,264 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-28 02:02:59,266 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-28 02:02:59,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=307e79415d70153caa0ca66502bcab74, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2e7911f4ba45c60b3bf4876cd8b3c7a9, UNASSIGN}] 2023-09-28 02:02:59,269 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=307e79415d70153caa0ca66502bcab74, UNASSIGN 2023-09-28 02:02:59,269 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2e7911f4ba45c60b3bf4876cd8b3c7a9, UNASSIGN 2023-09-28 02:02:59,269 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=307e79415d70153caa0ca66502bcab74, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:02:59,269 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2e7911f4ba45c60b3bf4876cd8b3c7a9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:02:59,269 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866579269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866579269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866579269"}]},"ts":"1695866579269"} 2023-09-28 02:02:59,269 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866579269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695866579269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695866579269"}]},"ts":"1695866579269"} 2023-09-28 02:02:59,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 307e79415d70153caa0ca66502bcab74, server=jenkins-hbase4.apache.org,41721,1695866465754}] 2023-09-28 02:02:59,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 2e7911f4ba45c60b3bf4876cd8b3c7a9, server=jenkins-hbase4.apache.org,42313,1695866465812}] 2023-09-28 02:02:59,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 02:02:59,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:59,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 307e79415d70153caa0ca66502bcab74, disabling compactions & flushes 2023-09-28 02:02:59,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:59,423 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. after waiting 0 ms 2023-09-28 02:02:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:59,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:59,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2e7911f4ba45c60b3bf4876cd8b3c7a9, disabling compactions & flushes 2023-09-28 02:02:59,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:59,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:59,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. after waiting 0 ms 2023-09-28 02:02:59,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:59,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:02:59,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:02:59,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:59,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:02:59,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9. 2023-09-28 02:02:59,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74. 2023-09-28 02:02:59,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 307e79415d70153caa0ca66502bcab74: 2023-09-28 02:02:59,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2e7911f4ba45c60b3bf4876cd8b3c7a9: 2023-09-28 02:02:59,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:59,440 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=307e79415d70153caa0ca66502bcab74, regionState=CLOSED 2023-09-28 02:02:59,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:59,440 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866579440"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866579440"}]},"ts":"1695866579440"} 2023-09-28 02:02:59,441 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2e7911f4ba45c60b3bf4876cd8b3c7a9, regionState=CLOSED 2023-09-28 02:02:59,441 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695866579441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695866579441"}]},"ts":"1695866579441"} 2023-09-28 02:02:59,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-28 02:02:59,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 307e79415d70153caa0ca66502bcab74, server=jenkins-hbase4.apache.org,41721,1695866465754 in 171 msec 2023-09-28 02:02:59,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-28 02:02:59,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 2e7911f4ba45c60b3bf4876cd8b3c7a9, server=jenkins-hbase4.apache.org,42313,1695866465812 in 170 msec 2023-09-28 02:02:59,444 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=307e79415d70153caa0ca66502bcab74, UNASSIGN in 176 msec 2023-09-28 02:02:59,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-28 02:02:59,445 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2e7911f4ba45c60b3bf4876cd8b3c7a9, UNASSIGN in 177 msec 2023-09-28 02:02:59,446 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695866579446"}]},"ts":"1695866579446"} 2023-09-28 02:02:59,447 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-28 02:02:59,448 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-28 02:02:59,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 190 msec 2023-09-28 02:02:59,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-28 02:02:59,566 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-28 02:02:59,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,569 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,570 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,571 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46883] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,574 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:59,574 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:59,574 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,574 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,574 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,574 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 02:02:59,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 02:02:59,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 02:02:59,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-28 02:02:59,576 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/recovered.edits] 2023-09-28 02:02:59,576 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,576 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,576 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/cf, FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/recovered.edits] 2023-09-28 02:02:59,576 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,576 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,576 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:59,576 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:59,576 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:59,576 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-28 02:02:59,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-28 02:02:59,579 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/cf/d342ba1d7e0c4ec7a2683d275e3b3814 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/cf/d342ba1d7e0c4ec7a2683d275e3b3814 2023-09-28 02:02:59,579 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/cf/c0f2732ae8384918b40a994d1dc240ed to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/cf/c0f2732ae8384918b40a994d1dc240ed 2023-09-28 02:02:59,582 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74/recovered.edits/9.seqid 2023-09-28 02:02:59,582 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/recovered.edits/9.seqid to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9/recovered.edits/9.seqid 2023-09-28 02:02:59,583 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/307e79415d70153caa0ca66502bcab74 2023-09-28 02:02:59,583 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2e7911f4ba45c60b3bf4876cd8b3c7a9 2023-09-28 02:02:59,583 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-28 02:02:59,583 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-28 02:02:59,584 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-28 02:02:59,588 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092887b6845ca6de481a877eeb3b608e0577 to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023092887b6845ca6de481a877eeb3b608e0577 2023-09-28 02:02:59,589 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309285d57906c6be344e8ab78f07ef93ad06f to hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309285d57906c6be344e8ab78f07ef93ad06f 2023-09-28 02:02:59,589 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-28 02:02:59,591 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,593 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-28 02:02:59,595 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-28 02:02:59,596 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,596 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-28 02:02:59,596 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866579596"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:59,596 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695866579596"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:59,598 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-28 02:02:59,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 307e79415d70153caa0ca66502bcab74, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695866564404.307e79415d70153caa0ca66502bcab74.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2e7911f4ba45c60b3bf4876cd8b3c7a9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695866564404.2e7911f4ba45c60b3bf4876cd8b3c7a9.', STARTKEY => '1', ENDKEY => ''}] 2023-09-28 02:02:59,598 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-28 02:02:59,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695866579598"}]},"ts":"9223372036854775807"} 2023-09-28 02:02:59,600 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-28 02:02:59,601 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-09-28 02:02:59,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-28 02:02:59,678 INFO [Listener at jenkins-hbase4.apache.org/34629] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-28 02:02:59,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-28 02:02:59,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-28 02:02:59,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-28 02:02:59,715 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 762) Potentially hanging thread: Thread-5327 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x52070e30-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x52070e30-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2134557900_1 at /127.0.0.1:52748 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:40490 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:51304 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1074870465) connection to jenkins-hbase4.apache.org/172.31.14.131:45561 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1324532370_17 at /127.0.0.1:52772 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=129 (was 118) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=4038 (was 4052) 2023-09-28 02:02:59,715 WARN [Listener at jenkins-hbase4.apache.org/34629] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-28 02:02:59,715 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-28 02:02:59,727 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 02:02:59,839 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695866472266_0007_01_000001 is : 143 2023-09-28 02:03:05,006 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-28 02:03:13,852 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 02:03:27,968 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 02:03:27,969 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 02:03:28,078 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-28 02:03:28,086 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-28 02:03:28,088 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 02:03:28,099 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-28 02:03:28,202 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-28 02:03:28,202 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-28 02:03:28,203 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-28 02:03:28,203 INFO [Listener at jenkins-hbase4.apache.org/34629] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-28 02:03:28,203 DEBUG [Listener at jenkins-hbase4.apache.org/34629] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5664efd5 to 127.0.0.1:56493 2023-09-28 02:03:28,203 DEBUG [Listener at jenkins-hbase4.apache.org/34629] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:03:28,203 DEBUG [Listener at jenkins-hbase4.apache.org/34629] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-28 02:03:28,203 DEBUG [Listener at jenkins-hbase4.apache.org/34629] util.JVMClusterUtil(257): Found active master hash=549704716, stopped=false 2023-09-28 02:03:28,203 DEBUG [Listener at jenkins-hbase4.apache.org/34629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:03:28,203 DEBUG [Listener at jenkins-hbase4.apache.org/34629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-28 02:03:28,203 INFO [Listener at jenkins-hbase4.apache.org/34629] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:03:28,205 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 02:03:28,205 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 02:03:28,205 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:03:28,205 INFO [Listener at jenkins-hbase4.apache.org/34629] procedure2.ProcedureExecutor(628): Stopping 2023-09-28 02:03:28,205 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 02:03:28,205 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-28 02:03:28,205 DEBUG [Listener at jenkins-hbase4.apache.org/34629] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0134430f to 127.0.0.1:56493 2023-09-28 02:03:28,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 02:03:28,205 DEBUG [Listener at jenkins-hbase4.apache.org/34629] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:03:28,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 02:03:28,206 INFO [Listener at jenkins-hbase4.apache.org/34629] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41721,1695866465754' ***** 2023-09-28 02:03:28,206 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1064): Closing user regions 2023-09-28 02:03:28,206 DEBUG [Listener at jenkins-hbase4.apache.org/34629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:03:28,206 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(3305): Received CLOSE for 95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:03:28,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 02:03:28,206 INFO [Listener at jenkins-hbase4.apache.org/34629] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 02:03:28,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-28 02:03:28,206 INFO [Listener at jenkins-hbase4.apache.org/34629] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42313,1695866465812' ***** 2023-09-28 02:03:28,206 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1064): Closing user regions 2023-09-28 02:03:28,206 DEBUG [Listener at jenkins-hbase4.apache.org/34629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:03:28,207 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(3305): Received CLOSE for c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:03:28,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 95f39af6ec1e3edf7b711cf6cb108464, disabling compactions & flushes 2023-09-28 02:03:28,208 INFO [RS:0;jenkins-hbase4:41721] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 02:03:28,207 INFO [Listener at jenkins-hbase4.apache.org/34629] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 02:03:28,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:03:28,208 INFO [RS:0;jenkins-hbase4:41721] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 02:03:28,209 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 02:03:28,209 INFO [RS:0;jenkins-hbase4:41721] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 02:03:28,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c79ed97ce3e02c2797c8a9084a3e5efd, disabling compactions & flushes 2023-09-28 02:03:28,209 INFO [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:03:28,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:03:28,209 DEBUG [RS:0;jenkins-hbase4:41721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c203099 to 127.0.0.1:56493 2023-09-28 02:03:28,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:03:28,209 INFO [Listener at jenkins-hbase4.apache.org/34629] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46883,1695866465849' ***** 2023-09-28 02:03:28,209 INFO [RS:1;jenkins-hbase4:42313] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 02:03:28,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:03:28,209 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 02:03:28,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. after waiting 0 ms 2023-09-28 02:03:28,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:03:28,209 DEBUG [RS:0;jenkins-hbase4:41721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:03:28,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. after waiting 0 ms 2023-09-28 02:03:28,210 INFO [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41721,1695866465754; all regions closed. 2023-09-28 02:03:28,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c79ed97ce3e02c2797c8a9084a3e5efd 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-28 02:03:28,209 INFO [RS:1;jenkins-hbase4:42313] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 02:03:28,209 DEBUG [Listener at jenkins-hbase4.apache.org/34629] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:03:28,211 INFO [RS:1;jenkins-hbase4:42313] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 02:03:28,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:03:28,211 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:03:28,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 95f39af6ec1e3edf7b711cf6cb108464 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-28 02:03:28,211 DEBUG [RS:1;jenkins-hbase4:42313] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4168517d to 127.0.0.1:56493 2023-09-28 02:03:28,211 INFO [Listener at jenkins-hbase4.apache.org/34629] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-28 02:03:28,211 DEBUG [RS:1;jenkins-hbase4:42313] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:03:28,213 INFO [RS:2;jenkins-hbase4:46883] regionserver.HeapMemoryManager(220): Stopping 2023-09-28 02:03:28,213 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-28 02:03:28,213 INFO [RS:2;jenkins-hbase4:46883] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-28 02:03:28,214 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1478): Online Regions={95f39af6ec1e3edf7b711cf6cb108464=hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464.} 2023-09-28 02:03:28,214 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-28 02:03:28,214 INFO [RS:2;jenkins-hbase4:46883] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-28 02:03:28,214 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:03:28,214 DEBUG [RS:2;jenkins-hbase4:46883] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37c9bba2 to 127.0.0.1:56493 2023-09-28 02:03:28,214 DEBUG [RS:2;jenkins-hbase4:46883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:03:28,214 INFO [RS:2;jenkins-hbase4:46883] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 02:03:28,215 INFO [RS:2;jenkins-hbase4:46883] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 02:03:28,215 INFO [RS:2;jenkins-hbase4:46883] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 02:03:28,215 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-28 02:03:28,215 DEBUG [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1504): Waiting on 95f39af6ec1e3edf7b711cf6cb108464 2023-09-28 02:03:28,216 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-28 02:03:28,217 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1478): Online Regions={c79ed97ce3e02c2797c8a9084a3e5efd=hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd., 1588230740=hbase:meta,,1.1588230740} 2023-09-28 02:03:28,218 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-28 02:03:28,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-28 02:03:28,218 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-28 02:03:28,218 DEBUG [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1504): Waiting on 1588230740, c79ed97ce3e02c2797c8a9084a3e5efd 2023-09-28 02:03:28,218 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-28 02:03:28,218 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-28 02:03:28,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-28 02:03:28,223 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 02:03:28,223 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 02:03:28,223 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-28 02:03:28,242 DEBUG [RS:0;jenkins-hbase4:41721] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/oldWALs 2023-09-28 02:03:28,242 INFO [RS:0;jenkins-hbase4:41721] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41721%2C1695866465754:(num 1695866467534) 2023-09-28 02:03:28,244 DEBUG [RS:0;jenkins-hbase4:41721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:03:28,244 INFO [RS:0;jenkins-hbase4:41721] regionserver.LeaseManager(133): Closed leases 2023-09-28 02:03:28,257 INFO [RS:0;jenkins-hbase4:41721] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-28 02:03:28,257 INFO [RS:0;jenkins-hbase4:41721] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 02:03:28,258 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 02:03:28,258 INFO [RS:0;jenkins-hbase4:41721] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 02:03:28,259 INFO [RS:0;jenkins-hbase4:41721] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 02:03:28,260 INFO [RS:0;jenkins-hbase4:41721] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41721 2023-09-28 02:03:28,264 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/.tmp/info/5f6da0b1f7644a1bab0dd7bcbdba36e4 2023-09-28 02:03:28,264 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464/.tmp/info/22d0b0f48acf450b9e180c0e10bda736 2023-09-28 02:03:28,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd/.tmp/l/a35bb8876ba048fd9b87753e81e5d555 2023-09-28 02:03:28,268 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:03:28,268 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:03:28,268 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 02:03:28,268 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 02:03:28,268 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41721,1695866465754 2023-09-28 02:03:28,269 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 02:03:28,269 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 02:03:28,271 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41721,1695866465754] 2023-09-28 02:03:28,272 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41721,1695866465754; numProcessing=1 2023-09-28 02:03:28,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f6da0b1f7644a1bab0dd7bcbdba36e4 2023-09-28 02:03:28,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464/.tmp/info/22d0b0f48acf450b9e180c0e10bda736 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464/info/22d0b0f48acf450b9e180c0e10bda736 2023-09-28 02:03:28,273 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41721,1695866465754 already deleted, retry=false 2023-09-28 02:03:28,274 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41721,1695866465754 expired; onlineServers=2 2023-09-28 02:03:28,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a35bb8876ba048fd9b87753e81e5d555 2023-09-28 02:03:28,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd/.tmp/l/a35bb8876ba048fd9b87753e81e5d555 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd/l/a35bb8876ba048fd9b87753e81e5d555 2023-09-28 02:03:28,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464/info/22d0b0f48acf450b9e180c0e10bda736, entries=2, sequenceid=6, filesize=4.8 K 2023-09-28 02:03:28,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 95f39af6ec1e3edf7b711cf6cb108464 in 68ms, sequenceid=6, compaction requested=false 2023-09-28 02:03:28,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a35bb8876ba048fd9b87753e81e5d555 2023-09-28 02:03:28,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd/l/a35bb8876ba048fd9b87753e81e5d555, entries=7, sequenceid=18, filesize=5.2 K 2023-09-28 02:03:28,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for c79ed97ce3e02c2797c8a9084a3e5efd in 81ms, sequenceid=18, compaction requested=false 2023-09-28 02:03:28,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/namespace/95f39af6ec1e3edf7b711cf6cb108464/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-28 02:03:28,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:03:28,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:03:28,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 95f39af6ec1e3edf7b711cf6cb108464: 2023-09-28 02:03:28,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695866468040.95f39af6ec1e3edf7b711cf6cb108464. 2023-09-28 02:03:28,306 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/.tmp/rep_barrier/737fd102b2c845f2b57d671b90e69dc8 2023-09-28 02:03:28,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/acl/c79ed97ce3e02c2797c8a9084a3e5efd/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-28 02:03:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:03:28,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:03:28,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c79ed97ce3e02c2797c8a9084a3e5efd: 2023-09-28 02:03:28,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695866468786.c79ed97ce3e02c2797c8a9084a3e5efd. 2023-09-28 02:03:28,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 737fd102b2c845f2b57d671b90e69dc8 2023-09-28 02:03:28,321 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/.tmp/table/27fe751b56f842d59f9b438f6951ce96 2023-09-28 02:03:28,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27fe751b56f842d59f9b438f6951ce96 2023-09-28 02:03:28,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/.tmp/info/5f6da0b1f7644a1bab0dd7bcbdba36e4 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/info/5f6da0b1f7644a1bab0dd7bcbdba36e4 2023-09-28 02:03:28,329 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f6da0b1f7644a1bab0dd7bcbdba36e4 2023-09-28 02:03:28,329 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/info/5f6da0b1f7644a1bab0dd7bcbdba36e4, entries=48, sequenceid=131, filesize=10.3 K 2023-09-28 02:03:28,330 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/.tmp/rep_barrier/737fd102b2c845f2b57d671b90e69dc8 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/rep_barrier/737fd102b2c845f2b57d671b90e69dc8 2023-09-28 02:03:28,334 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 737fd102b2c845f2b57d671b90e69dc8 2023-09-28 02:03:28,334 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/rep_barrier/737fd102b2c845f2b57d671b90e69dc8, entries=13, sequenceid=131, filesize=6.4 K 2023-09-28 02:03:28,334 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/.tmp/table/27fe751b56f842d59f9b438f6951ce96 as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/table/27fe751b56f842d59f9b438f6951ce96 2023-09-28 02:03:28,339 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27fe751b56f842d59f9b438f6951ce96 2023-09-28 02:03:28,339 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/table/27fe751b56f842d59f9b438f6951ce96, entries=24, sequenceid=131, filesize=6.9 K 2023-09-28 02:03:28,340 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 121ms, sequenceid=131, compaction requested=false 2023-09-28 02:03:28,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-28 02:03:28,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-28 02:03:28,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-28 02:03:28,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-28 02:03:28,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-28 02:03:28,351 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-28 02:03:28,362 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-28 02:03:28,362 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-28 02:03:28,371 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 02:03:28,371 INFO [RS:0;jenkins-hbase4:41721] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41721,1695866465754; zookeeper connection closed. 2023-09-28 02:03:28,371 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:41721-0x100f043dd070001, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 02:03:28,372 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4522b92c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4522b92c 2023-09-28 02:03:28,382 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-28 02:03:28,382 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-28 02:03:28,415 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42313,1695866465812; all regions closed. 2023-09-28 02:03:28,418 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46883,1695866465849; all regions closed. 2023-09-28 02:03:28,423 DEBUG [RS:1;jenkins-hbase4:42313] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/oldWALs 2023-09-28 02:03:28,423 INFO [RS:1;jenkins-hbase4:42313] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42313%2C1695866465812:(num 1695866467533) 2023-09-28 02:03:28,423 DEBUG [RS:1;jenkins-hbase4:42313] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:03:28,423 INFO [RS:1;jenkins-hbase4:42313] regionserver.LeaseManager(133): Closed leases 2023-09-28 02:03:28,423 INFO [RS:1;jenkins-hbase4:42313] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-28 02:03:28,424 INFO [RS:1;jenkins-hbase4:42313] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-28 02:03:28,424 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 02:03:28,424 INFO [RS:1;jenkins-hbase4:42313] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-28 02:03:28,424 INFO [RS:1;jenkins-hbase4:42313] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-28 02:03:28,425 INFO [RS:1;jenkins-hbase4:42313] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42313 2023-09-28 02:03:28,425 DEBUG [RS:2;jenkins-hbase4:46883] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/oldWALs 2023-09-28 02:03:28,425 INFO [RS:2;jenkins-hbase4:46883] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46883%2C1695866465849.meta:.meta(num 1695866467742) 2023-09-28 02:03:28,426 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 02:03:28,426 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:03:28,426 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42313,1695866465812 2023-09-28 02:03:28,429 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42313,1695866465812] 2023-09-28 02:03:28,429 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42313,1695866465812; numProcessing=2 2023-09-28 02:03:28,430 DEBUG [RS:2;jenkins-hbase4:46883] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/oldWALs 2023-09-28 02:03:28,430 INFO [RS:2;jenkins-hbase4:46883] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46883%2C1695866465849:(num 1695866467534) 2023-09-28 02:03:28,430 DEBUG [RS:2;jenkins-hbase4:46883] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:03:28,431 INFO [RS:2;jenkins-hbase4:46883] regionserver.LeaseManager(133): Closed leases 2023-09-28 02:03:28,431 INFO [RS:2;jenkins-hbase4:46883] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-28 02:03:28,431 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 02:03:28,432 INFO [RS:2;jenkins-hbase4:46883] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46883 2023-09-28 02:03:28,432 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42313,1695866465812 already deleted, retry=false 2023-09-28 02:03:28,432 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42313,1695866465812 expired; onlineServers=1 2023-09-28 02:03:28,529 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 02:03:28,530 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:42313-0x100f043dd070002, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 02:03:28,529 INFO [RS:1;jenkins-hbase4:42313] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42313,1695866465812; zookeeper connection closed. 2023-09-28 02:03:28,530 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6691d81f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6691d81f 2023-09-28 02:03:28,531 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46883,1695866465849 2023-09-28 02:03:28,531 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-28 02:03:28,532 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46883,1695866465849] 2023-09-28 02:03:28,532 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46883,1695866465849; numProcessing=3 2023-09-28 02:03:28,533 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46883,1695866465849 already deleted, retry=false 2023-09-28 02:03:28,533 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46883,1695866465849 expired; onlineServers=0 2023-09-28 02:03:28,533 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44049,1695866464521' ***** 2023-09-28 02:03:28,533 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-28 02:03:28,533 DEBUG [M:0;jenkins-hbase4:44049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61fede37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-28 02:03:28,533 INFO [M:0;jenkins-hbase4:44049] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44049,1695866464521 2023-09-28 02:03:28,533 INFO [M:0;jenkins-hbase4:44049] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44049,1695866464521; all regions closed. 2023-09-28 02:03:28,533 DEBUG [M:0;jenkins-hbase4:44049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-28 02:03:28,533 DEBUG [M:0;jenkins-hbase4:44049] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-28 02:03:28,533 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-28 02:03:28,534 DEBUG [M:0;jenkins-hbase4:44049] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-28 02:03:28,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695866467154] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695866467154,5,FailOnTimeoutGroup] 2023-09-28 02:03:28,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695866467158] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695866467158,5,FailOnTimeoutGroup] 2023-09-28 02:03:28,534 INFO [M:0;jenkins-hbase4:44049] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-28 02:03:28,534 INFO [M:0;jenkins-hbase4:44049] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-28 02:03:28,534 INFO [M:0;jenkins-hbase4:44049] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-28 02:03:28,534 DEBUG [M:0;jenkins-hbase4:44049] master.HMaster(1512): Stopping service threads 2023-09-28 02:03:28,534 INFO [M:0;jenkins-hbase4:44049] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-28 02:03:28,534 ERROR [M:0;jenkins-hbase4:44049] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-28 02:03:28,535 INFO [M:0;jenkins-hbase4:44049] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-28 02:03:28,535 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-28 02:03:28,535 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-28 02:03:28,536 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-28 02:03:28,536 DEBUG [M:0;jenkins-hbase4:44049] zookeeper.ZKUtil(398): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-28 02:03:28,536 WARN [M:0;jenkins-hbase4:44049] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-28 02:03:28,536 INFO [M:0;jenkins-hbase4:44049] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-28 02:03:28,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-28 02:03:28,536 INFO [M:0;jenkins-hbase4:44049] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-28 02:03:28,537 DEBUG [M:0;jenkins-hbase4:44049] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-28 02:03:28,537 INFO [M:0;jenkins-hbase4:44049] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 02:03:28,537 DEBUG [M:0;jenkins-hbase4:44049] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 02:03:28,537 DEBUG [M:0;jenkins-hbase4:44049] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-28 02:03:28,537 DEBUG [M:0;jenkins-hbase4:44049] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 02:03:28,537 INFO [M:0;jenkins-hbase4:44049] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.91 KB heapSize=452.12 KB 2023-09-28 02:03:28,550 INFO [M:0;jenkins-hbase4:44049] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.91 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4bef1e69cb0c4c969fd705741cb1b09e 2023-09-28 02:03:28,554 INFO [M:0;jenkins-hbase4:44049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bef1e69cb0c4c969fd705741cb1b09e 2023-09-28 02:03:28,555 DEBUG [M:0;jenkins-hbase4:44049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4bef1e69cb0c4c969fd705741cb1b09e as hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4bef1e69cb0c4c969fd705741cb1b09e 2023-09-28 02:03:28,559 INFO [M:0;jenkins-hbase4:44049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bef1e69cb0c4c969fd705741cb1b09e 2023-09-28 02:03:28,559 INFO [M:0;jenkins-hbase4:44049] regionserver.HStore(1080): Added hdfs://localhost:35003/user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4bef1e69cb0c4c969fd705741cb1b09e, entries=119, sequenceid=899, filesize=28.7 K 2023-09-28 02:03:28,560 INFO [M:0;jenkins-hbase4:44049] regionserver.HRegion(2948): Finished flush of dataSize ~375.91 KB/384929, heapSize ~452.10 KB/462952, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=899, compaction requested=false 2023-09-28 02:03:28,562 INFO [M:0;jenkins-hbase4:44049] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-28 02:03:28,562 DEBUG [M:0;jenkins-hbase4:44049] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-28 02:03:28,566 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/11468845-71f5-1c15-8816-ab937ee0295d/MasterData/WALs/jenkins-hbase4.apache.org,44049,1695866464521/jenkins-hbase4.apache.org%2C44049%2C1695866464521.1695866466344 not finished, retry = 0 2023-09-28 02:03:28,632 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 02:03:28,632 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): regionserver:46883-0x100f043dd070003, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 02:03:28,632 INFO [RS:2;jenkins-hbase4:46883] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46883,1695866465849; zookeeper connection closed. 2023-09-28 02:03:28,632 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@613ff848] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@613ff848 2023-09-28 02:03:28,633 INFO [Listener at jenkins-hbase4.apache.org/34629] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-28 02:03:28,667 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-28 02:03:28,667 INFO [M:0;jenkins-hbase4:44049] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-28 02:03:28,668 INFO [M:0;jenkins-hbase4:44049] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44049 2023-09-28 02:03:28,669 DEBUG [M:0;jenkins-hbase4:44049] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44049,1695866464521 already deleted, retry=false 2023-09-28 02:03:28,771 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 02:03:28,771 INFO [M:0;jenkins-hbase4:44049] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44049,1695866464521; zookeeper connection closed. 2023-09-28 02:03:28,771 DEBUG [Listener at localhost/36725-EventThread] zookeeper.ZKWatcher(600): master:44049-0x100f043dd070000, quorum=127.0.0.1:56493, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-28 02:03:28,773 WARN [Listener at jenkins-hbase4.apache.org/34629] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 02:03:28,776 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 02:03:28,880 WARN [BP-762092261-172.31.14.131-1695866460646 heartbeating to localhost/127.0.0.1:35003] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 02:03:28,880 WARN [BP-762092261-172.31.14.131-1695866460646 heartbeating to localhost/127.0.0.1:35003] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-762092261-172.31.14.131-1695866460646 (Datanode Uuid 3b8c3915-3094-4d3c-84e3-770e2527949b) service to localhost/127.0.0.1:35003 2023-09-28 02:03:28,882 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data5/current/BP-762092261-172.31.14.131-1695866460646] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 02:03:28,882 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data6/current/BP-762092261-172.31.14.131-1695866460646] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 02:03:28,883 WARN [Listener at jenkins-hbase4.apache.org/34629] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 02:03:28,886 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 02:03:28,989 WARN [BP-762092261-172.31.14.131-1695866460646 heartbeating to localhost/127.0.0.1:35003] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 02:03:28,989 WARN [BP-762092261-172.31.14.131-1695866460646 heartbeating to localhost/127.0.0.1:35003] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-762092261-172.31.14.131-1695866460646 (Datanode Uuid 2792056d-c488-441c-a5fa-5fb161447518) service to localhost/127.0.0.1:35003 2023-09-28 02:03:28,989 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data3/current/BP-762092261-172.31.14.131-1695866460646] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 02:03:28,990 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data4/current/BP-762092261-172.31.14.131-1695866460646] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 02:03:28,991 WARN [Listener at jenkins-hbase4.apache.org/34629] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-28 02:03:28,993 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 02:03:29,096 WARN [BP-762092261-172.31.14.131-1695866460646 heartbeating to localhost/127.0.0.1:35003] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-28 02:03:29,096 WARN [BP-762092261-172.31.14.131-1695866460646 heartbeating to localhost/127.0.0.1:35003] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-762092261-172.31.14.131-1695866460646 (Datanode Uuid a40d966c-8083-4c10-a3e3-0fee32a5c6ac) service to localhost/127.0.0.1:35003 2023-09-28 02:03:29,096 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data1/current/BP-762092261-172.31.14.131-1695866460646] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 02:03:29,097 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/982da39e-a21a-93df-ee2f-5d64dc52128e/cluster_1f0bb0c4-38d6-07e2-c3c8-8d1c52866198/dfs/data/data2/current/BP-762092261-172.31.14.131-1695866460646] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-28 02:03:29,118 INFO [Listener at jenkins-hbase4.apache.org/34629] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-28 02:03:29,244 INFO [Listener at jenkins-hbase4.apache.org/34629] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-28 02:03:29,337 INFO [Listener at jenkins-hbase4.apache.org/34629] hbase.HBaseTestingUtility(1293): Minicluster is down